Signing Tommy James after his release from the Detroit Lions turned out to be another masterstroke by Paul Brown. Following an injury-shortened rookie year in Detroit that ended with a broken arm, the former Ohio State defensive back returned to his home state in 1948, quickly earning a starting job in Cleveland's secondary during the final two dominant runs of the All-America Football Conference (AAFC).

James immediately solidified the back end of Paul Brown’s defense. Blending sharp instincts with aggressive, physical coverage, he helped guide Cleveland to back-to-back undefeated and championship AAFC seasons in 1948 and 1949. When the Browns moved to the NFL in 1950, James proved his style translated seamlessly, helping defeat the Los Angeles Rams in the 1950 NFL Championship Game to capture the franchise's third straight league title across two leagues.

His individual production hit its stride in the early 1950s as a focal point of Cleveland’s defense. James earned his lone Pro Bowl selection during the 1953 season, picking off a career-high nine passes and returning them for 164 yards. He went on to help anchor two more championship runs, grabbing back-to-back NFL titles in 1954 and 1955 while regularly shutting down opponents’ downfield passing attacks.

After eight seasons in Cleveland (1948–1955), James spent his final NFL campaign with the Baltimore Colts in 1956 before hanging up his cleats. With the Browns, James played in 94 regular-season games, snatched 34 interceptions, and won five league titles (two AAFC, three NFL). The Browns permanently honored his role as a foundational champion by naming him a Cleveland Browns Legend in 2004.