Viewing a single comment thread. View all comments

xt-89 t1_jbsaabf wrote

Reply to comment by [deleted] in [P] GITModel: Dynamically generate high-quality hierarchical topic tree representations of GitHub repositories using customizable GNN message passing layers, chatgpt, and topic modeling. by NovelspaceOnly

I also plan on applying the basic idea of a GNN with prompting to the thought loop of an cognitive entity (basically open assistant). I believe if you take the tree your outputting for code, but use it to aid CoT reasoning, that could be pretty powerful

3

[deleted] t1_jbsama8 wrote

Yes exactly! That’s the a major goal of this project. I plan on incorporating the inference server that Yannic set up for open assistant.

1

NovelspaceOnly OP t1_jbsdr55 wrote

I have some preliminary generation scripts for SMILES chemical graphs, Feynman diagrams, storytelling with interleaved images, and testing compilation rates. sorry for switching accounts. this one is logged on my laptop lol..

1

xt-89 t1_jbt5yyd wrote

That’s cool. I assume you’re going to apply this to memories for the agent. There’s already relevant research on how to do that. Here’s one from Facebookresearch: https://ai.facebook.com/blog/retrieval-augmented-generation-streamlining-the-creation-of-intelligent-natural-language-processing-models/

1

NovelspaceOnly OP t1_jbu2nki wrote

yes! I would describe my repo as very aligned with ideas from Yann Lecun. "composition of clever abstractions"

1