Fetch users by ID instead of Username

For #44 (closed) I think we need to stop fetching objects by properties other then the ID, if possible. Only then are they automatically cached. For now, the two biggest offenders are fixed, which should help things.