http://www.tested.com/tech/457440-theoretical-vs-actual-bandwidth-pci-express-and-thunderbolt/

PCIe 1.0: 2.5GT/s, 250MB/s per lane

PCIe 2.0: 5GT/s, 500MB/s per lane

PCIe 3.0: 8GT/s, 985MB/s per lane

apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: nvmeof-nginx
spec:
  #replicas: 2
  template:
    metadata:
      labels:
        run: nvmeof-nginx
    spec:
      volumes:
      - name: www
        nvmef:
          # Address of the iSCSI target portal
          targetPortal: "40.10.10.114:1023"
          # NQN of the portal
          nqn: "nqn.testiqn"
          # LUN we want to mount
          ns: 1
          # transport
          transport: "rdma"
          # Filesystem on the LUN
          fsType: ext4
          readOnly: false

      containers:
      - name: my-nginx
        image: nginx
        ports:
        - name: web
          containerPort: 80
          protocol: TCP
        volumeMounts:
        # 'name' must match the volume name below.
        - name: www
          # Where to mount he volume.
          mountPath: "/usr/share/nginx/html/"

http://neuralnetworksanddeeplearning.com/index.html

Host(/dev/nvme0n1)
259,0 3 2 0.001517626 2767 Q R 713574320 + 8 [fio]
259,0 3 3 0.001519131 2767 G R 713574320 + 8 [fio]
259,0 3 4 0.001522356 2767 U N [fio] 1
259,0 3 5 0.001522797 2767 I RS 713574320 + 8 [fio]
259,0 3 6 0.001524471 2767 D RS 713574320 + 8 [fio]
259,0 4 1 0.001737904 0 C RS 713574320 + 8 [0]

Target(/dev/nvme0n1)
259,0 2 1 0.001476259 1975 Q R 713574320 + 8 [kworker/u17:2]
259,0 2 2 0.001477725 1975 G R 713574320 + 8 [kworker/u17:2]
259,0 2 3 0.001481089 1975 D RS 713574320 + 8 [kworker/u17:2]
259,0 2 4 0.001535899 0 C RS 713574320 + 8 [0]

 
Q – queued:
generic_make_request_checks: trace_block_bio_queue(q, bio)

G – get request:
blk_mq_map_request: trace_block_getrq(q, bio, op)

U:
blk_mq_insert_requests: trace_block_unplug(q, depth, !from_schedule)

I – inserted:
__blk_mq_insert_req_list: trace_block_rq_insert(hctx->queue, rq)

D – issued:
blk_mq_start_request: trace_block_rq_issue(q, rq)

C – complete:
blk_update_request: trace_block_rq_complete(req->q, req, nr_bytes)