Clarke beat off competition from Irish FA boss David Martin 37-18 in a vote at the UEFA Congress in Rome on Thursday.
He takes the spot vacated by former Manchester United chief executive David Gill as the British representative on the FIFA Council.
Clarke had signalled his desire to take on the role when Gill announced that he was stepping down last year.
At one point Clarke could have been elected unopposed, but Martin stepped up to provide competition.
However, the vote proved relatively comfortable for the 51-year-old, who has been in his current FA role since 2016.
Clarke is a former chairman and director of Leicester City and also worked as chairman of the Football League from 2010 until just before his FA appointment was confirmed.
The eight FIFA vice-presidents earn annual salaries of £190,000 during their four-year terms.
Kariobangi Sharks
Homeboyz
Ulinzi Stars
Mathare United
KCB
Posta Rangers FC
Bandari
APS Bomet
Murang'a SEAL
Gor Mahia
Bidco United
Shabana
Fulham
Newcastle
Liverpool
Brentford
Burnley
Wolves
Chelsea
Tottenham
Bournemouth
Manchester City
Arsenal
Valencia
Barcelona
Celta Vigo
Sevilla
Espanyol
Real Sociedad
Real Betis
Atletico Madrid
Girona
Athletic Club
FAR Rabat
Mamelodi Sundowns
Migori Youth
Kibera Black Stars
Darajani Gogo
Vihiga United FC
Gucha Stars
Luanda Villa
Talanta
Fortune Sacco
Soy United