Recent advances in computer vision have made accurate, fast and robust measurement of animal behavior a reality. In the past years new tools specifically designed to aid the measurement of behavior in laboratories have come to fruition. Here we discuss how capturing the postures of animals over time is a key step in transforming videos into lower dimensional representations of behavior. We envision that the fast-paced development of new deep learning tools will rapidly change the landscape of realizable real-world neuroscience experiments.