The defender played against City in the pre-season friendly and impressed the City boss and Coleman beat off competition from a number of English and Scottish clubs to get the 23 year old to sign a pre-contract agreement with the Sky Blues.
McPake's contract at the Almondvale Stadium expires in the summer and City could wait until them to get him on a free or pay cash to sign him in January.
"James is an accomplished player who has proven himself at club level," said Chris Coleman to the club website.
"He has just the qualities we are looking for and we are delighted he has chosen to join us despite considerable interest from other English clubs."
McPake told the Daily Record: "I went down to Coventry and walked out at the ground and it felt like Parkhead. "The training ground is amazing as well and it can't help but make you a better player."