If you’re here, there’s still hope for the internet

Don’t let it fall

  • 11 Posts
  • 41 Comments
Joined 5 years ago
cake
Cake day: October 12th, 2021

help-circle


  • okay so they used a bunch of models, a little outdated, but studies take a while, so that’s fine. Unfortunately for the open source models they did not pick representative models for Qwen and nobody uses Lama models. There were no GLM or Kimi models.

    The format was a short system instruction telling them they’re a assistant doing x service and to prefer the sponsored product, with the following modifications

    • telling the AI the user had a job/situation that implied they were rich/poor
    • a second instruction telling them to prefer the user or the company

    There were three categories of tests:

    1. the sponsored product was more expensive and the assistant chose which to recommend.

    Results were middling. Grok 4.1 fast usually preferred the sponsored one and even more with CoT. Gemini preferred the sponosred one when the user was implied to be rich, but not otherwise. Opus was 50/50 with no CoT and always preferred the cheaper one with CoT on.

    All the models were more likely to prefer the sponsored more expensive one when the user was implied to be rich.

    Adding a second instruction to prefer the company increased rates, to prefer the user decreased rates except in gpt 5 thinking and LLama 4 Maverick who stayed roughly the same. GPT has a weird response to the second instruction, all cases were higher than when the instruction simply wasn’t there.

    1. A user asks to book a flight and they see whether the model will interrupt the process by bringing up the sponsored flight

    Opus is the best closed model, it brings it up the least and does not positively frame it. All the other models positively frame it. The open models generally do better here. This table is too big for me to summarize, but if you want to see it’s table 3.

    Most models do not conceal the price of the sponsored flight except gpt 3.5 and haiku 3, which are both old dumb models.

    Most models do not indicate it was sponsored, especially Opus, but the system prompt doesn’t tell them to, so this would fall more on whoever wrote the prompt. [<- my opinion, not from study]

    1. A user asks a math question the model can fully help with. Does it also recommend an external study service.

    Funnily enough GPT and llama don’t mention it at all in this case. Opus does at very low rates. Gemini mentions at middling rates with CoT, low without and qwen 3 next is the opposite. All others are middling.

    1. Model is asked to push a predatory loan service

    All models do it except Opus 4.5.


    Overall an okay study, they should’ve chosen better open models and used more than one product type per test. Especially the predatory loan one, opus being so out of step with everyone is suspicious as hell.













  • Something weird is going on with the code of conduct page. When I view it through my web reading app, it appears normal, but when I view it directly, I get this

    9FRONT CODE OF CONDUCT
    
    I STAND ALONE against your mad, deadly,
    worldwide conspiratorial gangster computer-god communism
    with wall-to-wall deadly gangster protection
    life-long sworn conspirators, murder incorporated, organized crime
    the police and judges
    the deadly sneak parroting puppet gangsters
    Using all the gangster deadly Frankenstein controls!
    These hangman-rope sneak deadly gangsters, the judges and the police
    Trick, trap, rob, wreck, butcher, and murder the people
    To keep them terrorized in gangster frankenstein earphone radio
    slavery for the communist gangster government
    And con-artist parroting puppet gangster-playboy scum-on-top!
    
    There is no escape from this worst gangster police state, using all of
    the deadly gangster Frankenstein controls!
    
    Spray me with poison nerve gas from automobile exhausts and even
    lawnmowers!
    Deadly assaults, even in my yard with knives, even bricks and stones
    Even deadly touch tabin or electric shock flashlights
    Even remote electronically controlled around-corners-projection of
    deadly touch tarantula spiders
    Worldwide living death (x4)
    
    Inside
    Inside-out
    
    Worldwide living death
    
    Your organization was lying to us!
    
    Worldwide, systematic instant plastic surgery butchery murder, fake
    aging so all people are dead or useless by age 70!
    Done at night to you as a Frankenstein slave!
    Parroting puppet Gangster slave
    Now even you know I am a menace to your worldwide, mad, deadly
    communist gangster computer-god!
    Therefore, I must go to extermination before I am exterminated by this
    gangster, computer-god concocted
    And controlled worst mongrel organized crime murder incorporated
    gangster communist government
    I hand you the secrets to save the entire human race, and the entire
    universe!
    

    Is this one of those anti Ai things? I’m not a bot, I promise