I want to project a 3D scene with a moving camera (animated over time). I have a 3x3 transformation matrix, calculated by A2 * (T * (R * A1)) where
A1 is 2D -> 3D matrix projection (I'm currently projecting a single 2D image but will extend to 3D points and remove this matrix)
T is Translation matrix
R is rotation matrix
A2 is 3D -> 2D matrix
I can use this in opencv's warpPerspective and get a decent result. Now, I want to move the camera position in 3D space, but have no idea how. OpenCV has a DecomposeProjectionMatrix which takes a 3x4 projection matrix, but I'm unclear how that relates to any that I have.