Dolphy was never married and is public with his relationships and family. For more than 20 years, he has been with Filipina singer, actress and model Zsa Zsa Padilla. They reside in the Multinational Village in the city of Parañaque. In his latest book, he mentioned that he had five serious relationships before Padilla who bore him offspring. The last was with actress Alma Moreno, who gave him a son: Vandolph. Some of his kids are in the business just like their father.
- Engracia (Gracia) Dominguez — an actress he met during a stage show (separated in 1963), six children: Manny (Manny Boy), Salud (Sahlee), Rodolfo Jr. (Dolphy Jr.), Freddie (Baby), Edgar, and Raul (Rolly).
- Gloria Smith — an actress he met in 1956, four children: Mariquita (Kaye), Carlos, Geraldino (Dino), and Edwin.
- Baby Smith — an actress whose screen name was Pamela Ponti, four children: Ronaldo (Ronnie), Enrico (Eric), Madonna (Dana), and Jeffrey (Epi).
- Evangeline Tugalao — a nurse he met in the late 60s while shooting in a hospital, one child: Rommel.
- Alma Moreno — an actress he met in 1981, one child: Vandolph.
- Zsa Zsa Padilla, with whom he has two daughters: Nicole (adopted) and Zia.
He considers his kids his pride and joy, and he could easily name all seventeen of his biological children and one adopted daughter from the oldest to the youngest