Python Opencv和套接字-流视频以h264编码

2024-05-22 • 问答

所以我试图制作一个流媒体，将视频从一台计算机流传输到局域网上的另一台计算机（或现在是同一台计算机）。我需要它使用尽可能少的带宽，所以我尝试在h264中进行编码。我在执行此操作时遇到了麻烦，而且我真的不知道从哪里开始。现在，它以jpg编码，并且正在逐帧发送。但是，我知道这效率很低，并且占用大量带宽。这是我当前的接收方代码。

import cv2
import socket
import _pickle
import time

host = "192.168.1.196"
port = 25565
boo = True

s = socket.socket(socket.AF_INET,socket.SOCK_STREAM) # declares s object with two parameters
s.bind((host,port)) # tells my socket object to connect to this host & port "binds it to it"
s.listen(10) # tells the socket how much data it will be receiving.

conn,addr = s.accept()
buf = ''
while boo:
        pictures = conn.recv(128000) # creates a pictures variable that receives the pictures with a max amount of 128000 data it can receive
        decoded = _pickle.loads(pictures) # decodes the pictures
        frame = cv2.imdecode(decoded,cv2.IMREAD_COLOR) # translates decoded into frames that we can see!
        cv2.imshow("recv",frame)
        if cv2.waitKey(1) & 0xFF == ord("q"):  # wait until q key was pressed once and
            break

这是我当前的客户代码（发送方）：

import cv2
import numpy as np
import socket
import _pickle
from cv2 import *

host = "192.168.1.196"
port = 25565

s = socket.socket(socket.AF_INET,socket.SOCK_STREAM)  # declares s object with two parameters
s.connect((host,port))  # connects to the host & port
cap = cv2.VideoCapture(1)
cv2.cv.CV_FOURCC('H','2','6','4')
while cap.isOpened(): # while camera is being used
    ret,frame = cap.read()  # reads each frame from webcam
    cv2.imshow("client",frame)
    if ret:
        encoded = _pickle.dumps(cv2.imencode("fourcc",frame)[1]) # encoding each frame,instead of sending live video it is sending pictures one by one
        s.sendall(encoded)
    if cv2.waitKey(1) & 0xFF == ord("q"): # wait until key was pressed once and
        break
cap.release()
cv2.destroyAllWindows()

我只需要一些有关如何在h264中对视频进行编码和解码的帮助。

您可以使用pyzmq和publish/subscribe模式以及base64字符串编码/解码来执行此操作。在服务器端，想法是：

从摄像机流中获取帧
使用cv2.imencode
使用base64将ndarray转换为str并通过套接字发送

在客户端，我们只是简单地逆转该过程：

从套接字读取图像字符串
使用base64将str转换为bytes
使用bytes + ndarray将np.frombuffer转换为cv2.imdecode

此方法不应使用太多带宽，因为它仅通过套接字发送字符串。

服务器

import base64
import cv2
import zmq

context = zmq.Context()
socket = context.socket(zmq.PUB)
socket.connect('tcp://localhost:7777')

camera = cv2.VideoCapture(0)

while True:
    try:
        ret,frame = camera.read()
        frame = cv2.resize(frame,(640,480))
        encoded,buf = cv2.imencode('.jpg',frame)
        image = base64.b64encode(buf)
        socket.send(image)
    except KeyboardInterrupt:
        camera.release()
        cv2.destroyAllWindows()
        break

客户

import cv2
import zmq
import base64
import numpy as np

context = zmq.Context()
socket = context.socket(zmq.SUB)
socket.bind('tcp://*:7777')
socket.setsockopt_string(zmq.SUBSCRIBE,np.unicode(''))

while True:
    try:
        image_string = socket.recv_string()
        raw_image = base64.b64decode(image_string)
        image = np.frombuffer(raw_image,dtype=np.uint8)
        frame = cv2.imdecode(image,1)
        cv2.imshow("frame",frame)
        cv2.waitKey(1)
    except KeyboardInterrupt:
        cv2.destroyAllWindows()
        break

Python Opencv和套接字-流视频以h264编码

chendian76 回答：Python Opencv和套接字-流视频以h264编码

大家都在问