There were a few teasers about GPT (Generative Pre-trained Transformer) in the last couple of years, particularly GPT-2 and GPT-3. These are from OpenAI company, which at first was open, but recent GPT-3 is not open, not free and not offline.
There is a free, open, standalone version of GPT-3 which is called GPT-Neo, and more recent GPT-JAX, or GPT-J, all from Eleuther AI, an AI research group
https://www.eleuther.ai/GPT kind of NN are very good at generating content starting from a given context. This can work so good that the AI can return working code, starting from nothing but a plain English description.
So far it works good enough only for small functions or code patterns that are found very often in code examples, github, or stackoverflow.
I've tried today (for Python only):
- GPT-J-6B engine in a webpage
https://6b.eleuther.ai/ (6B stands for its size, 6 Billions parameters)
- Codeon as a VScode extension
https://github.com/sdpmas/Codeon - Kite
https://www.kite.com/ as a VScode extension + local install of Kite Engine (GPT-2), which acts like autocomplete but seems smarter and more useful than the usual ms-python (IntelliSense).
The free ones I've tried are not as impressive as the teasers for the payed 'GitHub Copilot' of Microsoft (powered by OpenAI's GPT-3 with 125B params), but the results are very encouraging even with the free ones. All I've seen so far are very simple examples or eye-catching demos, so not sure how useful such a free tool would be for writing small Python programs as a hobby.
Anybody here using such tools instead of stackoverflow?
What other free+standalone/offline coding helpers I should try?