Purpose To identify access barriers to physical rehabilitation for traffic accident (TA) victims with severe disability and build a theoretical model to provide guidance towards the improvement of these services. Methods Qualitative research carried out in the city of Natal (Northeast Brazil), with semi-structured interviews with 120 subjects (19 key informer health professionals and 101 TA victims) identified in a database made available by the emergency hospital. The interviews were analyzed using Alceste software, version 4.9. Results The main barriers present in the interviews were: (1) related to services: bureaucratic administrative practises, low offer of rehabilitation services, insufficient information on rehabilitation, lack of guidelines that integrate hospital and ambulatory care and (2) related to patients: financial difficulties, functional limitations, geographic distance, little information on health, association with low education levels and disbelief in the system and in rehabilitation. Conclusion The numerous access barriers were presented in a theoretical model with causes related to organizational structure, processes of care, professionals and patients. This model must be tested by health policy-makers and managers to improve the quality of physical rehabilitation and avoid unnecessary prolongation of the suffering and disability experienced by TA survivors. Implications for rehabilitation Traffic accidents (TAs) are a global health dilemma that demands integrality of preventive actions, pre-hospital and hospital care and physical rehabilitation (PR). This study lays the foundation for improving access to PR for TA survivors, an issue of quality of care that results in preventable disabilities. The words of the patients interviewed reveal the suffering of victims, which is often invisible to society and given low priority by health policies that relegate PR to a second plan ahead of prevention and urgent care. A theoretical model of the causes of the problem of access to PR was built. The identified barriers are potentially preventable through the intervention of health policy-makers, managers, regulators and rehabilitation professionals, and by encouraging the participation of patients. Addressing timely access barriers involves the expansion of the supply of services and rehabilitation professionals, regulation and standardization of referencing practises and encouraging the provision of information to patients about continuity of care and their health needs.