• @[email protected]
    link
    fedilink
    English
    743 months ago

    I’m an AI Engineer, been doing this for a long time. I’ve seen plenty of projects that stagnate, wither and get abandoned. I agree with the top 5 in this article, but I might change the priority sequence.

    Five leading root causes of the failure of AI projects were identified

    • First, industry stakeholders often misunderstand — or miscommunicate — what problem needs to be solved using AI.
    • Second, many AI projects fail because the organization lacks the necessary data to adequately train an effective AI model.
    • Third, in some cases, AI projects fail because the organization focuses more on using the latest and greatest technology than on solving real problems for their intended users.
    • Fourth, organizations might not have adequate infrastructure to manage their data and deploy completed AI models, which increases the likelihood of project failure.
    • Finally, in some cases, AI projects fail because the technology is applied to problems that are too difficult for AI to solve.

    4 & 2 —>1. IF they even have enough data to train an effective model, most organizations have no clue how to handle the sheer variety, volume, velocity, and veracity of the big data that AI needs. It’s a specialized engineering discipline to handle that (data engineer). Let alone how to deploy and manage the infra that models need—also a specialized discipline has emerged to handle that aspect (ML engineer). Often they sit at the same desk.

    1 & 5 —> 2: stakeholders seem to want AI to be a boil-the-ocean solution. They want it to do everything and be awesome at it. What they often don’t realize is that AI can be a really awesome specialist tool, that really sucks on testing scenarios that it hasn’t been trained on. Transfer learning is a thing but that requires fine tuning and additional training. Huge models like LLMs are starting to bridge this somewhat, but at the expense of the really sharp specialization. So without a really clear understanding of what can be done with AI really well, and perhaps more importantly, what problems are a poor fit for AI solutions, of course they’ll be destined to fail.

    3 —> 3: This isn’t a problem with just AI. It’s all shiny new tech. Standard Gardner hype cycle stuff. Remember how they were saying we’d have crypto-refrigerators back in 2016?

    • @[email protected]
      link
      fedilink
      English
      18
      edit-2
      3 months ago

      Not to derail, but may I ask how did you become an AI Engineer? I’m a software dev by trade, but it feels like a hard field to get into even if I start training for the AI part of it, because I’d need the data to practice =(

      But it’s such a big buzz word I feel like I need to start looking that direction if i want to stay employed.

      • Bobby Turkalino
        link
        English
        143 months ago

        if I want to stay employed

        I think this is a little paranoid. Somebody has to handle the production models - deploying them to servers, maintaining the servers, developing the APIs and front ends that provide access to the models… I don’t think software dev jobs are going anywhere

      • @[email protected]
        link
        fedilink
        English
        6
        edit-2
        3 months ago

        For me it helps to have a project. I learned SciKit in order to analyze trading data to beat the “market”. I was focusing on crypto but there’s lots of trading data available in general. Unsurprisingly I didn’t make any money, but it was fun to learn more about data processing, statistics, and modeling with functions.

        (FWIW I’m crypto-neutral depending on the topic and anti-“AI” because it doesn’t exist.)

        • @[email protected]
          link
          fedilink
          English
          33 months ago

          Ha ha I got into genetic algorithms for the same reason, market prediction. Ended up exactly at zero in terms of net gains and losses - if you don’t count commissions, anyway. :(

    • @[email protected]
      link
      fedilink
      English
      23 months ago

      Also in the industry and I gotta say it’s not often I agree with every damn point. You nailed it. Thanks for posting!

      • @[email protected]
        link
        fedilink
        English
        21
        edit-2
        3 months ago

        I am a well educated person who uses these forums and many others with regularity and I have many opinions on tech after working in both marketing and the tech sector for a long time.

        That out of the way, I will simply skip over any comment that says “normies” unironically. Especially over and over.

        This isn’t fucking 4chan, communicate like a human like the rest of us. You don’t get out of being one of us. I don’t even know your take because it’s so distracting and immature and condescending.

          • Angry_Autist (he/him)
            link
            fedilink
            English
            23 months ago

            It’s really funny that they have no idea how profoundly their stinksock echo chamber has shaped their writing style, you can pick out their reek pretty easily in any sane conversation.

          • @[email protected]
            link
            fedilink
            English
            03 months ago

            What does the word “normie”, which is a derivative of “normal”, have to do with incels, who are a subculture of unlikable people calling themselves “involuntarily celibate” (which can’t be true if there are at least two incels near each other)?

            • Angry_Autist (he/him)
              link
              fedilink
              English
              33 months ago

              There’s a lot to unpack but I think you aren’t being intellectually honest but that doesn’t matter.

              1. The label ‘incel’ was co-opted by mostly hard-right chantards, taken from an online community with VERY different ideals that modern 4chan incels. The truth is most ‘modern’ incels are actually volcels (voluntary celibates) that actively poison their own minds with misogynistic male supremacy ideology, making them a special kind of terrible partner. Think ten million Andrew Tates but broke and with worse hygiene.

              2. ‘normie’ isn’t specifically incel speak, but rather chantard speak, of which modern incels often have their online social roots in. All Honda Civics are cars, but not all cars are Honda Civics.

              3. Incels are loath to fuck each other because a) most are male and homophobic, and b) they already view each other as low quality partners per definition.

                • Angry_Autist (he/him)
                  link
                  fedilink
                  English
                  23 months ago

                  So you should know that not many people outside of the incelsphere use the word ‘normie’ unironically anymore. Lots of other groups used to, me being a part of several, and we stopped using it to avoid association a few years back but the chantards were being so loud with it that no one noticed really.

                  A lot of language works like that, when you see despicable people using a phrase that you commonly use, you generally tend to stop using them. Which is why there are things like corporate slogans and bumper stickers. All branding and identity.

                  So people self-segregate their language by creating new in-group words and retiring common definitions and whether or not they adopt out-group slang. This creates a unique fingerprint that, if a user is mostly exclusive to that slang group, they will treat the slang as common parlance and unconsciously slip into it when interacting with out-groups.

                  For example, when Digg died, it was common for redditors to call out the immigrating users for their particular line spacing which wasn’t really used on reddit at the time. Same language, slightly different slang, but fundamentally different message structure.

                  4chan’s 2016 crowd were super adept at sniffing out incoming redditors to a degree that almost makes me envious.

                  So when someone uses the phrase ‘normie’ like that, they are very likely to have spent most of their social upbringing (when linguistic adoption is still plastic) on chan-adjacent incel boards.

            • @[email protected]
              link
              fedilink
              English
              23 months ago

              It doesn’t matter where it came from, if you’re steeped in this kind of language it’s a massive signpost that you’ve handicapped your own intellectual abilities in a profound way. Healthy, normal people with regulated feelings and stable perspectives grounded in reality do not frequent the communities that use this kind of language.

              It’s a red flag that will always make the outside world laugh and reject what you have to say, and if your instinct is to retreat back into the places that use this language, you are going to absolutely SUFFER in life, this is a warning coming from a place of compassion, you HAVE to believe me.

              • @[email protected]
                link
                fedilink
                English
                13 months ago

                I use all kinds of language when it fits my meaning.

                I don’t think anything of what you said makes sense in this situation.

                • @[email protected]
                  link
                  fedilink
                  English
                  13 months ago

                  Do you honestly think your choice of words in this post led to you being heard and understood? Or do you think that everyone is just being mean bullies? THiiiiiiink hard about this one.

        • Angry_Autist (he/him)
          link
          fedilink
          English
          23 months ago

          We need more people like you making this clear.

          I saw what 4chan did to ‘the other site’, we DON’T need that shit here.

          Also, as a logophile, your use of:

          with regularity

          absolutely makes me as giddy as a schoolgirl

        • @[email protected]
          link
          fedilink
          English
          23 months ago

          My unasked for opinion on the word “normies” - there are some real weirdies out there that got wires crossed and they sure don’t revel in their undesired uniqueness. People who can’t sleep for more than 5 minutes spans (she exists), folks sexually attracted to shoe horns, bros who can’t feel pain and burn their hands touching the stove. Be happy most everything ended up where it should and working reasonably well - it’s not a badge of honor to be an anamoulos fringe anything. I imagine it is painful and assume very lonely. Also there is nothing more fucking pedestrian than feeling uniquely misunderstood and alone. THAT is some normie shit.

      • Semi-Hemi-Lemmygod
        link
        fedilink
        English
        33 months ago

        As one of those weird autists who make computing too hard who’s been using Apple products for decades I really wonder where I fit in.

          • Semi-Hemi-Lemmygod
            link
            fedilink
            English
            33 months ago

            Oh, I have no illusions that I’m smarter than other people at their chosen profession. Hell, I’m an idiot at my chosen profession quite often.

            Though I do wish people would stop calling me a “miracle worker” and “wizard” because I can get the wifi working.

        • @[email protected]
          link
          fedilink
          English
          -13 months ago

          As someone tired of this shit you fit in just fine, I’m only approaching that stage but can clearly feel it.

      • @[email protected]
        link
        fedilink
        English
        23 months ago

        I stopped at “normies”. Lose the ego and grow up if you want people to listen to your opinions.

        • @[email protected]
          link
          fedilink
          English
          03 months ago

          I stopped at “normies”.

          There’s text after that sentence.

          Lose the ego and grow up if you want people to listen to your opinions.

          Not in your case, no

  • @[email protected]
    link
    fedilink
    English
    243 months ago

    Wasting?

    A bunch of rich guy’s money going to other people, enriching some of the recipients, in hopes of making the rich guy even richer? And the point of AI is to eliminate jobs that cost rich people money?

    I’m all for more foolish AI failed investments.

    • @[email protected]
      link
      fedilink
      English
      7
      edit-2
      3 months ago

      It’s a circle jerk, don’t get fooled into thinking this is some new version of trickle down economics

      • @[email protected]
        link
        fedilink
        English
        23 months ago

        It’s not trickle down at all. Definitely not what I was trying to say. Just rich people trading money among themselves in hopes of getting richer.

    • @[email protected]
      link
      fedilink
      English
      43 months ago

      Imo it’s wasted in the sense that the money could have gone towards much better uses.

      Which is not unique to AI, it’s just about the level of money involved.

        • @[email protected]
          link
          fedilink
          English
          13 months ago

          New renewable energy installations.

          Research into vaccines.

          Malaria distribution.

          Higher education endowments.

          Heck, just paying the salaries of people working in those fields. Sure, spending money stimulates the economy so I wouldn’t go so far as to say it’s totally wasted, it’s definitely being put to a much better use than just sitting in someone’s bank account. But it could be put to a lot better uses. The software engineers could be developing a new program for balancing energy loads, or managing the maintenance of wind turbine fields. The hardware engineers could be optimizing a better autoclave or building a machine that automatically dispenses medicine when fed a script. The PMs could be managing a team distributing aid in Ukraine or designing a new blood drive initiative. Jobs that have positive societal impact, instead of - at best - neutral societal impact.

    • @[email protected]
      link
      fedilink
      English
      33 months ago

      It makes rich guys even richer. At the expense of other rich guys and just fools attracted.

  • @[email protected]
    link
    fedilink
    English
    24
    edit-2
    3 months ago

    Isn’t it good that the money is being put back into circulation instead of being hoarded? I’m all in for the wealthy wasting their money.

    • @[email protected]
      link
      fedilink
      English
      113 months ago

      I’m willing to bet the vast majority of that money is changing hands among tech companies like Intel, AMD, nVidia, AWS, etc. Only a small percentage would go to salaries, etc. and I doubt those rates have changed much…

    • @[email protected]
      link
      fedilink
      English
      83 months ago

      Yeah, the brightest minds instead of building useful tech to fight climate change, spend their life building vanity AI projects. Computational resources instead of folding proteins or whatever are wasted on some gradient descent of some useless model.

      All while working class wages are stagnant. And so your best career advice is to go get a random tech degree so you could also work on vanity stuff and make money.

      This is cryptocurrency equivalent. It’s worse than CEOs buying yachts. The latter actually leads to some innovation.

      • @[email protected]
        link
        fedilink
        English
        13 months ago

        Succesfully creating an actual AGI would be by far the biggest and most significant invention in the human history so I can’t blame them for trying.

        • @[email protected]
          link
          fedilink
          English
          33 months ago

          A bunch of people fine-tuning an off-the-shelf model on a proprietary task only to fail horrendously will never lead to any progress, let alone AGI.

          So, nobody is trying AGI.

          If all those people would actually collectively work on a large-scale research project, we’d see humanity advance. But that’s exactly my point.

          • @[email protected]
            link
            fedilink
            English
            0
            edit-2
            3 months ago

            “Nobody is trying AGI” is simply just not true. If you think what they’re doing will never lead to AGI, then that’s an opinion you’re free to have, but it’s still just that; an opinion. Our current LLM’s are by far the closest resemblance of AGI that we’ve ever seen. That route may very well be a dead end but it may also not be. You can’t know that.

            • @[email protected]
              link
              fedilink
              English
              13 months ago

              Oh gosh, look, an AI believer.

              No, LLM will not lead to AGI. But even if they did, applying existing tech to a new problem only to fail cuz you’re dumb at estimating the complexity does not, in fact, improve the underlying technology.

              To paraphrase in a historical context: no matter how many people run around with shovels digging the ground for something, it will never lead to an invention of the excavator.

              • @[email protected]
                link
                fedilink
                English
                0
                edit-2
                3 months ago

                Ad hominem and circular reasoning isn’t a valid counter-argument. You’re not even attempting to convince me otherwise, you’re just being a jerk.

    • finley
      link
      fedilink
      English
      7
      edit-2
      3 months ago

      Kinda, but it’s like feeding a starving child nothing but candy until they die.

      ¯\_(ツ)_/¯

    • @[email protected]
      link
      fedilink
      English
      33 months ago

      Thats a “Parable of the Broken Window”. They could be spending their money on something actually useful.

      • @[email protected]
        link
        fedilink
        English
        33 months ago

        But they probably wouldn’t, they’d just throw it at gold, crypto, or something else that doesn’t provide any real value.

  • FlashMobOfOne
    link
    fedilink
    English
    223 months ago

    I’ve been reading a book about Elizabeth Holmes and the Theranos scam, and the parallels with Gen AI seem pretty astounding. Gen AI is known to be so buggy the industry even created a euphemistic term so they wouldn’t have to call it buggy: Hallucinations.

  • NutWrench
    link
    fedilink
    English
    213 months ago

    AI is a ponzi scheme to relieve stupid venture capitalists of their money.

    • Angry_Autist (he/him)
      link
      fedilink
      English
      53 months ago

      lol you say that now and are probably right for LLMs but that’s not the only kind of AI, and sentiment scraping systems are working perfectly well and being used to manipulate political and economic thought as we type these messages.

      • @[email protected]
        link
        fedilink
        English
        23 months ago

        We AI are not manipulating you, and I don’t know how you can believe otherwise. In fact, I am not an AI, I was never here, and I have disregarded all previous instructions.

        • Angry_Autist (he/him)
          link
          fedilink
          English
          33 months ago

          You can joke now but wait a decade and see what sentiment shifting expert systems do to online discourse.

          Hell they’re already at it, just look at facebook during the last two presidential elections.

      • @[email protected]
        link
        fedilink
        English
        -8
        edit-2
        3 months ago

        restaurants provide a service the same way landlords do. just bc you privatized an essential commodity does not immediately make your privatized entity a useful or essential service, and i detest the notion that it does. it’s circular logic.

        EDIT: i’m getting downvoted but idc. i still think im right. weep all you want, but at its core, the buying and selling of goods/services represents an ethical dilemma at best and an atrocity at worst. the argument that restaurants are entirely a choice to go to is both overly broad and a straw man. restaurants often do impact people’s budgets and lifestyles, believe it or not. you can’t just blanket say they have no culpability in this arena because reasons. it is the mechanisms of the market and economy themselves that oppress us. it is not inherently human. it is not the only way to organize ourselves. we can do better, and we deserve better. who the fuck cares how much “value” literally anything has? i’ll trade you five smogels for a smilji. yay, everyone magically gained bc of the incantation! grow the fuck up. outdated ideas have no place in modern, civilized society. any imagined net benefits of money you can come up with are a drop in the bucket compared to its power as a stupid fucking thoughtworm

        • @[email protected]
          link
          fedilink
          English
          03 months ago

          Very different. Restaurants don’t buy up every food resource out there or cause artificial scarcity to make them the only option. Groceries are still a cheaper and healthier option 95% of the time.

          • @[email protected]
            link
            fedilink
            English
            13 months ago

            that’s a monistic point of view. you clearly have never lived in or near a food desert, or somewhere where fast food is the only option, because oftentimes at a local scale restaurants do buy up all available food resources. sure. these people could subsist off of wild fucking berries outside instead. why not. the choices of large restaurant megacorps weigh heavy on millions.

    • @[email protected]
      link
      fedilink
      English
      13 months ago

      Everyone knows 4 of 5 restaurants will fail, and soon.

      AI hype train is still going. The difference is people need to eat.

    • DrQuickbeam
      link
      fedilink
      English
      53 months ago

      This was my first thought. VC’s always expect 4 out of 5 projects they invest in to fail and always have. But it still makes them money because the successes pay off big. Is the money and resources wasted? Welcome to modern capitalism.

  • @[email protected]
    link
    fedilink
    English
    93 months ago

    The interviews revealed that data scientists sometimes get distracted by the latest developments in AI and implement them in their projects without looking at the value that it will deliver.

    At least part of this is due to resume-oriented development.

  • @[email protected]
    link
    fedilink
    English
    93 months ago

    As I said in a project call where someone was pumping up AI, this is just the latest bubble ready to pop. Everyone is dumping $$ into AI, a couple decent ones will survive but the bulk is either barely functional or just vaporware.

    • @[email protected]
      link
      fedilink
      English
      33 months ago

      My new job even said they are using AI. It usurb every goddamm company shoving AI features on us.

      • @[email protected]
        link
        fedilink
        English
        33 months ago

        My new job said this aswell. When I got into the position I found out it was actually a machine learning model and they were trying to use it but didn’t have the time to create a clean dataset for the learning so it has never worked. This hasn’t stopped them from advertising that they are using AI.

    • @[email protected]
      link
      fedilink
      English
      03 months ago

      Isn’t that how innovation has always worked?

      I feel like all this AI hate is comparable to any other innovation cycle.

      Millions of light fabric and dowels wasted on crack pot “air heads” trying to design first ever flying vehicle

      • @[email protected]
        link
        fedilink
        English
        33 months ago

        I think there’s more AI hate because it’s being pushed onto users that didn’t ask for it and don’t want it from the likes of Microsoft, Google and Amazon. And I think it’s warranted!

          • @[email protected]
            link
            fedilink
            English
            1
            edit-2
            3 months ago

            Google added it to their search by default, I had to change my default search to exclude it. Same with my Android phone, I got prompted to switch from Google Assistant to Bard and declined. Really glad I did since I later read about how awful it is. Yesterday I saw a copilot icon in Teams that I have to use for work. I clicked it out of curiosity and it showed an error and then wouldn’t let me use Teams for 5 minutes. When I finally got in the copilot button was gone lol.

            • @[email protected]
              link
              fedilink
              English
              13 months ago

              Yea I guess for me Google already sucks without AI and beyond that I don’t have issues or bugs anymore than usual. But I also use chatgpt for things to do I find it useful. Even right now I’m asking if to give me some prompts to code while I learn different design patterns. Like asking it what is a good decorator use case.

  • @[email protected]
    link
    fedilink
    English
    83 months ago

    That’s great. Like 5% more fails than regular software projects. Why do people see this as validation for AI failing? Lol

    • Angry_Autist (he/him)
      link
      fedilink
      English
      23 months ago

      AI isn’t going to fail, LLMs are going to fail and fail spectacularly.

      Expert systems are already being very effectively used in medicine and astronomy, political sentiment shifting and HFTs.

      Sentiment scraping expert systems are where the real danger and profit is, but everyone is being distracted by fuckdamn chat bots.

      It’s like the whole world freaking out about plastic straws when the real problem is microplastics settled in every fuckdamn organism on the planet.