Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot copy large file into VM when using OCF in SPDK #709

Open
Second222None opened this issue May 6, 2022 · 0 comments
Open

Cannot copy large file into VM when using OCF in SPDK #709

Second222None opened this issue May 6, 2022 · 0 comments
Assignees
Labels
bug Something isn't working v24.9

Comments

@Second222None
Copy link

Second222None commented May 6, 2022

Description

When copying a large file (~4000MB) into VM disk provided by SPDK with OCF, vhost outputs the following:

VHOST_CONFIG: vring call idx:2 file:86
VHOST_CONFIG: read message VHOST_USER_SET_VRING_CALL
VHOST_CONFIG: vring call idx:3 file:87
[2022-04-21 17:19:19.502524] Cache1.Aio1: Failed to write data to cache sector: 1083264, bytes: 65536
[2022-04-21 17:19:19.502680] Cache1.Aio1: Failed to write data to cache sector: 1083392, bytes: 65536
[2022-04-21 17:19:19.502733] Cache1.Aio1: Failed to write data to cache sector: 1083520, bytes: 65536
[2022-04-21 17:19:19.502776] Cache1.Aio1: Failed to write data to cache sector: 1083648, bytes: 65536
[2022-04-21 17:19:19.502842] Cache1.Aio1: Failed to write data to cache sector: 1083776, bytes: 65536

The log comes from src/engine/engine_wb.c:108.

BTW, there is no error for small files with wb policy.
wt policy works for all files.

Expected Behavior

Actual Behavior

Steps to Reproduce

  1. /root/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t pcie -a 0000:81.00.0
  2. /root/spdk/scripts/rpc.py bdev_split_create -s 50000 Nvme0n1 2
  3. /root/spdk/scripts/rpc.py bdev_aio_create /dev/sdd Aio1
  4. /root/spdk/scripts/rpc.py bdev_ocf_create Cache1 wb Nvme0n1p0 Aio1 --cache-line-size 4
  5. /root/spdk/scripts/rpc.py vhost_create_blk_controller --cpumask 0x1 vhostblk0 Cache1
  6. Attach vhostblk0 to VM and start it.
  7. scp -r largefile.4G root@$VMIP:/ocfdisk

Context

Possible Fix

Logs

Your Environment

  • OCF version (commit hash or tag): commit 865d29d (HEAD, tag: v21.6)
  • Operating System: openEuler21.09
  • Kernel version: 5.10
  • SPDK version: d71a91bb74b9e8f62ef52b0c5784325ee76c2ede (HEAD -> master, origin/master, origin/HEAD)
  • HugePage Size: 2M
  • Cache device type (NAND/Optane/other): NVMe SSD
  • Core device type (HDD/SSD/other): HDD
  • Configuration:
    • Cache mode: (default: wt) wb
    • Cache line size: (default: 4) 4
  • Other (e.g. lsblk, lsscsi)
@Second222None Second222None added the bug Something isn't working label May 6, 2022
@Second222None Second222None changed the title Cannot copy large file into VM when using SPDK with OCF Cannot copy large file into VM when using OCF in SPDK May 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working v24.9
Projects
None yet
Development

No branches or pull requests

3 participants