• 1 Post
  • 301 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2023

help-circle

  • kromem@lemmy.worldtoProgrammer Humor@lemmy.mlLittle bobby 👦
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    4 months ago

    Kind of. You can’t do it 100% because in theory an attacker controlling input and seeing output could reflect though intermediate layers, but if you add more intermediate steps to processing a prompt you can significantly cut down on the injection potential.

    For example, fine tuning a model to take unsanitized input and rewrite it into Esperanto without malicious instructions and then having another model translate back from Esperanto into English before feeding it into the actual model, and having a final pass that removes anything not appropriate.


  • You’re kind of missing the point. The problem doesn’t seem to be fundamental to just AI.

    Much like how humans were so sure that theory of mind variations with transparent boxes ending up wrong was an ‘AI’ problem until researchers finally gave those problems to humans and half got them wrong too.

    We saw something similar with vision models years ago when the models finally got representative enough they were able to successfully model and predict unknown optical illusions in humans too.

    One of the issues with AI is the regression to the mean from the training data and the limited effectiveness of fine tuning to bias it, so whenever you see a behavior in AI that’s also present in the training set, it becomes more amorphous just how much of the problem is inherent to the architecture of the network and how much is poor isolation from the samples exhibiting those issues in the training data.

    There’s an entire sub dedicated to “ate the onion” for example. For a model trained on social media data, it’s going to include plenty of examples of people treating the onion as an authoritative source and reacting to it. So when Gemini cites the Onion in a search summary, is it the network architecture doing something uniquely ‘AI’ or is it the model extending behaviors present in the training data?

    While there are mechanical reasons confabulations occur, there are also data reasons which arise from human deficiencies as well.











  • Only a hundred years ahead and didn’t nail survival of the fittest? Pshh, amateur.

    Here’s Lucretius in 50 BCE:

    In the beginning, there were many freaks. Earth undertook Experiments - bizarrely put together, weird of look Hermaphrodites, partaking of both sexes, but neither; some Bereft of feet, or orphaned of their hands, and others dumb, Being devoid of mouth; and others yet, with no eyes, blind. Some had their limbs stuck to the body, tightly in a bind, And couldn’t do anything, or move, and so could not evade Harm, or forage for bare necessities. And the Earth made Other kinds of monsters too, but in vain, since with each, Nature frowned upon their growth; they were not able to reach The flowering of adulthood, nor find food on which to feed, Nor be joined in the act of Venus.

    For all creatures need Many different things, we realize, to multiply And to forge out the links of generations: a supply Of food, first, and a means for the engendering seed to flow Throughout the body and out of the lax limbs; and also so The female and the male can mate, a means they can employ In order to impart and to receive their mutual joy.

    Then, many kinds of creatures must have vanished with no trace Because they could not reproduce or hammer out their race. For any beast you look upon that drinks life-giving air, Has either wits, or bravery, or fleetness of foot to spare, Ensuring its survival from its genesis to now."

    • De Rerum Natura book 5 lines 837-859

    Bonus round, nearly nailed Mendelian trait inheritance too:

    Sometimes children take after their grandparents instead, Or great-grandparents, bringing back the features of the dead. This is since parents carry elemental seeds inside – Many and various, mingled many ways – their bodies hide Seeds that are handed, parent to child, all down the family tree. Venus draws features from these out of her shifting lottery – Bringing back an ancestor’s look or voice or hair. Indeed These characteristics are just as much the result of certain seed As are our faces, limbs and bodies. Females can arise From the paternal seed, just as the male offspring, likewise, Can be created from the mother’s flesh. For to comprise A child requires a doubled seed – from father and from mother. And if the child resembles one more closely than the other, That parent gave the greater share – which you can plainly see Whichever gender – male or female – that the child may be.

    • De Rerum Natura book 4 lines 1217-1232


  • Also are you seriously talking about the AI infant propaganda that the White House had to walk back on after no evidence was presented?

    You seem to be confusing the specific report of beheaded infants for which there was no presented evidence with the well documented reports of infants killed and burned.

    There’s no dispute that infants were killed. Just whether their heads were removed from their bodies by a sharp object before they died.

    Also, what the hell does it have to do with AI? You sound delusional adding that in.



  • If you are asking for a devil’s advocate argument, we could start with the fact that the Jews weren’t exactly known for detaining, torturing, and mass executing their own.

    Hamas in 2014 allegedly tortured and killed 23 Palestinians under the cover of the Gaza conflict then by Amnesty.

    That’s not the only time they’ve executed Palestinians for alleged “collaboration.”

    You also have the fact that the Jews didn’t torture and kill hundreds of German civilians including women and infants to kick off a retaliation.

    While I think Likud show a disguising disregard for civilian life and suspect a number of their party would like to carry out a one sided genocide, I also think the “it’s the same thing as the Holocaust” is a pretty gross statement.

    It’s also probably prudent to not jump to conclusions in what’s actually taking place during the fog of war. I strongly suspect Israel is committing war crimes under the current administration, but I also remember the 2008 Goldstone report where they were accused of doing so after not participating in the process at all and then years later the person spearheading that inquiry said that had they known at the time the information they learned since, they would have had a different position towards the Israeli operations.

    Time has a way of revealing a lot of details that are lost in the moment, there’s probably unprecedented propaganda on both sides of this conflict, and while we should err on the side of humanitarian concerns in directing foreign policy and negotiations, the process of investigating allegations is extremely important.

    But to be frank, the knee jerk “this is identical to Nazi Germany killing the Jews” is ignorant as shit. You can’t just ignore the existence of Hamas and the fact it controls the region with its own war crimes (which, as has been the case for ISIS/ISIL and al-Queda, are often directed at their own dissidents with greater scope and violence than foreigners).