I would rather say:

Пока я смотрел телевизор, младенец заполз в комнату. :)

The only problem I have is with the usage of "младенец" who seems to be too young to be able to "ползать." I would...