The proportion of rehabilitation doctors and patients mismatch is very grim in the context of social aging. The Family Rehabilitation System captures the profound information of the trainer’s movements through the kinect bone tracing technique, allowing the doctor to remotely master the patient’s training progress. With the help of computers and the Internet, the patient can consult a physician, while the physician can remotely guide and launch the training “prescription” through the Internet according to the training effect. Patients can have rehabilitated training at home. The results of the test showed that the system has a positive effect on the rehabilitation of the patient.