Despite the widespread offer of free HIV testing in France, the proportion of people who have never been tested remains high. The objective of this study was to identify, in men and women separately, the various factors independently associated with no lifetime HIV testing. We used multilevel logistic regression models on data from the SIRS cohort, which included 3006 French-speaking adults as a representative sample of the adult population in the Paris metropolitan area in 2010. The lifetime absence of any HIV testing was studied in relation to individual demographic and socioeconomic factors, psychosocial characteristics, sexual biographies, HIV prevention behaviors, attitudes towards people living with HIV/AIDS (PLWHA), and certain neighborhood characteristics. In 2010, in the Paris area, men were less likely to have been tested for HIV at least once during their lifetime than women. In multivariate analysis, in both sexes, never having been tested was significantly associated with an age younger or older than the middle-age group (30-44 years), a low education level, a low self-perception of HIV risk, not knowing any PLWHA, a low lifetime number of couple relationships, and the absence of any history of STIs. In women, other associated factors were not having a child < 20 years of age, not having additional health insurance, having had no or only one sexual partner in the previous 5 years, living in a cohabiting couple or having no relationship at the time of the survey, and a feeling of belonging to a community. Men with specific health insurance for low-income individuals were less likely to have never been tested, and those with a high stigma score towards PLWHA were more likely to be never-testers. Our study also found neighborhood differences in the likelihood of men never having been tested, which was, at least partially, explained by the neighborhood proportion of immigrants. In contrast, in women, no contextual variable was significantly associated with never-testing for HIV after adjustment for individual characteristics. Studies such as this one can help target people who have never been tested in the context of recommendations for universal HIV screening in primary care.