They only follow real villians
Well the movie didn't say that the minions were smart.
They might have ended up in Rome after the failed Egypt attempt.The Minions then turns out to be the reason why almost the entire ancient Rome burned down during the Nero era.
The minions arent smart but have luck