Very interesting results! So far I haven't done anything with any AI, I'm too old to add yet another technology to my working set. I'm trying to use less, not more
If I understand it correct from what you wrote: you take a photo and give movement instructions to create the video. Correct?
If I'm not mistaking the Sweet Home 3D virtual tour video is created by generating transitions between two or more photo's, i.e. saved camera positions. I think the plan is used to calculate the transitions and uses a lot of zoom to simulate movement.
Maybe AI can generate transitions between two photo's, a little like the old-time morphing software did 20-30 years ago but now with movement from one to the other. It will probably need a different AI but it could be a (better?) alternative for the long creation times of a Sweet Home 3D video. Then stitch the different videos together to get a longer video.
Your initial experiments are very promising, especially since you only started it a few days ago. I'm looking forward to seeing more!
----------------------------------------
Dodecagon.nl
1300+ 3D models, manuals, and projects
