If you said, "Tom entered his room and saw his brother playing with his toys", the reader would infer that the toys belonged to Tom, since they were in Tom's room.