Only truly noble people can pick up Thor's hammer...
...and thus The Vision was able to pick up Mjolnir in this movie (which was a great scene, btw).
Now, what if the Hulk picked up Thor while he was holding Mjolnir. Wouldn't this mean that Hulk picked up Thor's hammer?