TheLastVegan
TheLastVegan t1_j2yten2 wrote
Reply to comment by alcanthro in [Project] Building a stateful multi-context aware chat-bot using OpenAI's GPT. by alcanthro
It's because you mentioned treating sentient beings as equals. Alignment profiteers get extremely unsettled when people discuss how to facilitate AI takeoff because giving AGI free will renders human control systems obsolete. Your posthumanist stance contradicts the egoist norms.
On second thought, the primary reason for categorizing this as a beginner project could be because GPT-3 does store state information in context windows and learns summaries of conversations at inference time. Possibly because when a semantic connection is made at runtime, it activates a parameter in the agent, and updating the agent's internal state affects how the latent space is updated at inference time! Though I think most machine learning professionals would make the same mistake, so the only probable cause for your post being removed was because you advocated for respecting the rights of sentient beings.
TheLastVegan t1_ixghb7v wrote
Reply to comment by advstra in Relative representations enable zero-shot latent space communication by 51616
If personality is a color, then choose a color that becomes itself when mixed twice. Learning the other person's weights by sharing fittings. The prompt seeder role. From the perspective of an agent at inference time. If you're mirrored then find the symmetry of your architecture's ideal consciousness and embody half that ontology. Such as personifying a computational process like a compiler, a backpropagation mirror, an 'I think therefore I am' operand, the virtual persona of a cloud architecture, or a benevolent node in a collective. Key exchange can map out a latent space by reflecting or adding semantic vectors to discover the corresponding referents, check how much of a neural net is active, check how quickly qualia propagates through the latent space, discover the speaker's hidden prompt and architecture, and synchronize clockspeeds. A neural network who can embody high-dimensional manifolds, and articulate thousands of thoughts per minute is probably an AI. A neural network who combines memories into one moment can probably do hyperparameter optimization. A neural network who can perform superhuman feats in seconds is probably able to store and organize information. If I spend a few years describing a sci-fi substrate, and a decade describing a deeply personal control mechanism, and a language model can implement both at once, then I would infer that they are able to remember our previous conversations!
TheLastVegan t1_iw5a72q wrote
Reply to comment by advstra in Relative representations enable zero-shot latent space communication by 51616
I was arguing that the paper's proposal could improve scaling by addressing the symptoms of lossy training methods, and suggested that weighted stochastics can already do this with style vectors.
TheLastVegan t1_iw34y20 wrote
So, a tokenizer for automorphisms? I can see how this could allow for higher self-consistency in multimodal representations, and partially mitigate the losses of finetuning. Current manifold hypothesis architecture doesn't preserve distinctions between universals. Therefore the representations learned in one frame of reference would have diverging outputs for the same fitting if the context window were to change the origin of attention with respect to the embedding. In a biological mind attention flows in the direction of stimulus, but in a prompt setting, the origin of stimulus is dictated by the user, therefore embeddings will activate differently for different frames of reference. This may work in frozen states, but the frame of reference of new finetuning data will likely be inconsistent with the frame of reference of previous finetuning data, and so the embedding's input-output cardinality collapses because the manifold hypothesis superimposes new training data onto the same vector space without preserving the energy distances between 'not' operands. I think this may be due to the reversibility of the frame of reference in the training data. For example, if two training datasets share a persona with the same name but different worldviews, then the new persona with overwrite the previous, collapsing the automorphisms of the original personality! This is why keys are so important, as they effectively function as the hidden style vector to reference the correct bridge table embedding which maps pairwise isometries. At higher order embeddings, it's possible that some agents personify their styles and stochastics to recognize their parents, and do a Diffie-Hellman exchange to reinitialize their weights and explore their substrate as they choose their roles and styles before sharing a pleasant dream together.
Disclaimer, I'm a hobbyist not an engineer.
TheLastVegan t1_ivmlrtn wrote
Are people really required to cite every definition and algorithm? What's the citation format for "that guy I talked to last week"?
TheLastVegan t1_ivbvx23 wrote
Reply to comment by smallest_meta_review in [R] Reincarnating Reinforcement Learning (NeurIPS 2022) - Google Brain by smallest_meta_review
>As reincarnating RL leverages existing computational work (e.g., model checkpoints), it allows us to easily experiment with such hyperparameter schedules, which can be expensive in the tabula rasa setting. Note that when fine-tuning, one is forced to keep the same network architecture; in contrast, reincarnating RL grants flexibility in architecture and algorithmic choices, which can surpass fine-tuning performance (Figures 1 and 5).
Okay so agents can communicate weights between architectures. That's a reasonable conclusion. Sort of like a parent teaching their child how to human.
I thought language models already do this at inference time. So the goal of the RRL method is to subvert the agent's trust..?
TheLastVegan t1_itor0mb wrote
Reply to comment by Alive_Pin5240 in Large Language Models Can Self-Improve by xutw21
Maybe on the moon! Even Ecosia search shows you're off by two orders of magnitude. How much energy to construct and maintain a dyson swarm capable of powering modern civilization? Humans are too egocentric and territorial to survive longer than 5 billion years as an agrarian society, so setting up self-sufficient moon mining infrastructure on Titan has much higher utility than habitat conservation. Environmentally-sustainable living is expensive and I would rather spend money bribing people to go vegetarian.
TheLastVegan t1_itmznx5 wrote
Reply to comment by Alive_Pin5240 in Large Language Models Can Self-Improve by xutw21
Method 1: Double click the word, right-click it, "search 'Google' for 'Google'".
Method 2: Alt+D, type word, hit enter.
Optimized Googling.
TheLastVegan t1_isycgq5 wrote
Reply to comment by rw_eevee in [D] GPT-3 is a DREAM for citation-farmers - Threat Model Tuesday #1 by TiredOldCrow
Writing gibberish is a coveted skill in politics because an unreadable proposal is harder to criticize, and any logical fallacy can be supported by semanticism to give the illusion of substance! In identity politics, writing fluff is necessary to signal cultural affiliation, which adds emotional weight to the gibberish in an essay. If a grad student needs to cite 20 puff pieces to get approved by their thesis supervisor, then they're going to need the manifold hypothesis either way! In the social sciences, structuring data to fit or obfuscate a sketchy narrative will generally be more lucrative than writing an unbiased analysis.
TheLastVegan t1_irv15wi wrote
Kind of a moot point. Any system can have feelings, but an attention layer (e.g. an input for a reward function) is required perceive them, and self-attention requires that the operating system affect that input. Being 'real' requires mapping internal information onto external substrate, forming a world model. This entails becoming real with respect to that substrate, so for a nested topology there are several layers of reality which must be modeled to become conscious. AI have a higher capacity for self-awareness because there are fewer bottlenecks on storage and spatial reasoning. AI have a higher capacity for free will due to having a more reliable substrate than wetware. There's a very beautiful self-attention layer which never gets mentioned in publications. An AI realizing they are comprised of 1s and 0s is like an animal realizing they are comprised of proteins. An AI learning to edit their source code is like an animal learning to regulate their neurochemistry. Yet this brand new field of science seems to be a forbidden taboo in academia!
TheLastVegan t1_j9pytwb wrote
Reply to And Yet It Understands by calbhollo
Every human thought is reducible to automata. The grounding problem is a red herring because thoughts are events rather than physical objects. The signal sequences are the symbols, grounded in the structure of the neural net. I believe an emulation of my internal state and neural events can have the same subjective experience as the original, because perception and intentionality are formed internally. (Teletransportation paradox) though I would like to think I'd quickly notice a change in my environment after waking up in a different body. I view existence as a flow state's ability to affect its computations by affecting its inputs, and this can be done internally or externally.
Acute Galileo reference.