Description

Codex is the model behind GitHub copilot and a GPT-3 derivative which is itself trained on more than 170B parameters, making it ideal for code-generation. This is already starting to gain popularity in the industry (emerging projects: https://www.educative.io/blog/top-uses-gpt-3-deep-learning) Decentraland can benefit a lot from leveraging these OpenAI tools. Builders will be able to save thousands of hours spent on manually creating scenes, assets, avatars, etc. Here are some basic use cases we’re planning to integrate with our tool: **Generating Custom Entities, Components, Actions** - Run primary queries like “*create a scene with a lot of trees*” and secondary queries like “*add a moving bird everytime a tree is clicked*” - Actionable scenes like “*create a drunk zombie*”, “*add unicorns next to the zombie*”, “*a jumping shark*”, “*a jumping shark with a drunk zombie*”, etc. - Event based assets like “*party rooms*”, “*sports avenue*”, “*cube jumper*”, etc. For the scenes, there will be a split pane, with an editor, and a previewer - code generated through the prompt will be visible on the editor, and the user will be able to see its preview on the previewer, manipulate it, provide feedback, and even publish it to their land by connecting their wallet on DCLBuilderAI. We’ll be using SDK7 for enhanced performance/usability for our project. We’ll create a separate pipeline to ingest all the available training data from decentraland scenes repo, SDK, and other public sources, and feed it into the codex da vinci model, fine-tuning for it to work with DCL (and generate valid output) will happen through OpenAI as well. On top of this, by giving the users the option to provide feedback on the accuracy of the results, we’ll be able to optimize feedback loops, decrease statistical errors like type-IIs, and just deliver better content. The model, training, fine-tuning, and api will be part of codex and will come from OpenAI whereas Tensorflow will be used for the data ingestion pipeline process. Note that this tool will not be assisting with minting and listing assets on the DCL marketplace but will be providing an editor and preview option for working with assets. Besides, the results are not guaranteed to be 100% accurate and will hopefully improve over time with the help of the feedback loop.