请问,如何解决速度慢的问题?
形状:(1、32、387、1)
数据时间:0.005219221115112305
发布时间:0.24771547317504883
结束时间:0.2498164176940918
shape:(2,32,387,1)
数据时间:0.0056378841400146484
发布时间:0.4651315212249756
结束时间:0.4693586826324463
docker run --runtime = nvidia -it --rm -p 8501:8501
-v“ $(pwd)/ densenet_ctc:/ models / docker_test”
-e MODEL_NAME = docker_test tensorflow / serving:最新gpu
-tensorflow_intra_op_parallelism = 8
-tensorflow_inter_op_parallelism = 8
-enable_batching = true
-batching_parameters_file = / models / docker_test / batching_parameters.conf
num_batch_threads {值:4}
batch_timeout_micros {值:2000}
max_batch_size {value:48}
max_enqueued_batches {值:48}
GPU:1080Ti
谢谢。