I'm 40, I've done 3dcg since the late 90s, went to school at SCAD for animation, the guy who animated mufasa was one of my professors, I've been working on creating a totally independent animation/film professional pipeline to youtube for over a decade now. blah blah
I don't think it's necessary to reinvent the wheel with this, so it would function basically as a plugin for existing AI film creation systems. To my knowledge there is no existing existing publicly available intuitive AI video creation software that goes beyond text prompts or crude image input. I'm an artist, but I know enough about AI and the technical side to know that what I envision with this plugin would be very much technically possible given current technology. All I'm talking about here is really just a way to have greater intuitive control over specific parameters in AI video production and greatly reduce the amount of computation required for preliminary work.
Something where the user has more direct control over AI image creation beyond just text prompts. Basic sliders, image inputs. Let's say you need a scene of a revolutionary war battle. The user provides a rough sketch of the composition, something you would see in the storyboarding or thumbnail phase. The AI gives a very low burden computational creation of it, maybe very low rez or whatever. You then further define the environment, characters, etc. Instead of saying "make the sky slightly grayer" there is just a simple slider that you can adjust tone/tint/hue etc like in photoshop or similar products. Instead of saying "make me a fight scene!" you either build the assets yourself, or define them specifically with concept art/reference images. Direction is handled directly with animatics an storyboards. These are capabilities that I know probably exist somewhere, but they are not being shared with the public and would be relatively easy for random collaborators on the internet to create.
What I'm talking about here from my understanding requires very little to basically no actual direct AI development, just a way to more intuitively and efficiently use existing capabilities. If people here want me to I can edit this original post an describe in excruciating detail exactly the features I would want down to the UI, specific functions, everything but the actual technical implementation. It might ultimately require some basic cooperation with an existing AI system, but that would be in the latest stages of development.
Let me stress this is not a "do this for me" thing and this could even be an open source effort. I have a very very specific very extensive description of exactly the features it would need. Everything, including UI, functionality, literally everything but the technical implementation.
Also to be specific, what I'm describing here is a professional level plugin. It's not meant for people who know nothing about filmmaking. Basically people at a graduate level from film school in terms of knowledge. Nor about creating new capabilities of AI, it's about using capabilities that I know exist within AI systems in an intuitive way with minimal computational burden on the systems.
[link] [comments]