Drafted in the sixth round (64th overall) of the 1954 NFL Draft out of Baylor, Jim Ray Smith arrived in Cleveland as an accomplished collegiate tackle who began his professional career along the defensive line. Smith served in a rotational role at defensive end as a rookie, but head coach Paul Brown quickly realized his rare athletic gifts were suited for a higher calling on the offensive front.

Brown shifted Smith to the offensive line, where he logged six starts at right guard in 1957 before settling permanently at left guard in 1958. That position change unlocked a Hall-of-Fame-caliber talent. Armed with explosive pull-block speed, exceptional balance, and leverage, Smith became the premier interior run-blocker in professional football, pulling across the formation to clear massive lanes for Jim Brown and Bobby Mitchell.

From 1958 through 1962, Smith went on an absolute tear, earning five consecutive Pro Bowl selections alongside five straight All-Pro nods (First-Team honors in 1959, 1960, and 1961). His ability to blow open defensive fronts on sweep plays powered Cleveland's record-setting rushing attacks throughout the late 1950s and early 1960s.

Believing he was ready to step away from the game, Smith briefly retired after the 1962 season. The Dallas Cowboys coaxed him back to the field, acquiring his rights via trade and securing two final seasons of his veteran leadership before he hung up his cleats for good after 1964.

In his seven seasons with the Browns (1956–1962), Smith played in 82 regular-season games and appeared in the 1957 NFL Championship Game. The organization honored his dominant reign at guard by inducting him into the Cleveland Browns Legends in 2005.