Considering characteristics of Remote Video Surveillance System, a system structure and logical model of Remote Video Surveillance System is proposed in this paper. A Remote Video Surveillance System based on PC is implemented, using DirectShow and DirectShow RTP framework under Visual C++ 6.0. As the presented approach is based on COM, the system has well reusability and extensibility.