TY - GEN
T1 - Action-conditioned convolutional future regression models for robot imitation learning
AU - Wu, Alan
AU - Piergiovanni, A. J.
AU - Ryoo, Michael S.
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/12/13
Y1 - 2018/12/13
N2 - Based on what is seen (i.e. visual input), humans are able to visually predict (i.e. regress) what the scene will look like after taking a certain action. Further, humans are able to take advantage of such predictions to select optimal actions for the task they are working on. Using example videos, robots can also learn to visually imagine the future consequence of taking an action. This can be viewed as learning a function mapping a raw image frame (conditioned on a particular action) to the future image frame. Once learned, the future regression function can be combined with an action policy learning framework (e.g. reinforcement or imitation learning), enabling better robot action learning for given tasks.
AB - Based on what is seen (i.e. visual input), humans are able to visually predict (i.e. regress) what the scene will look like after taking a certain action. Further, humans are able to take advantage of such predictions to select optimal actions for the task they are working on. Using example videos, robots can also learn to visually imagine the future consequence of taking an action. This can be viewed as learning a function mapping a raw image frame (conditioned on a particular action) to the future image frame. Once learned, the future regression function can be combined with an action policy learning framework (e.g. reinforcement or imitation learning), enabling better robot action learning for given tasks.
UR - https://www.scopus.com/pages/publications/85060863039
U2 - 10.1109/CVPRW.2018.00274
DO - 10.1109/CVPRW.2018.00274
M3 - Conference contribution
AN - SCOPUS:85060863039
T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
SP - 2116
EP - 2118
BT - Proceedings - 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018
PB - IEEE Computer Society
T2 - 31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018
Y2 - 18 June 2018 through 22 June 2018
ER -