Is this in regards to a specific recent event or article? Or just purely hypothetical?
In practice, an AI that’s trained on drug-drug interactions, duplicate therapies, and common dosings would be beneficial. We already have specialized models that are helping scientists discover groundbreaking technologies, such as recent advancements in discovering cancers years before we are used to with more traditional methods.
Let’s look at your hypothetical. Prescriber sends in an order to their in-house pharmacy for amoxicillin and the patient has a recorded penicillin allergy. Under ideal circumstances, the pharmacist would review the patients chart, note the potential for a reaction (While they are different antibiotics, there is still potential for a reaction due to the drugs being related), and contact the prescriber to verify therapy and discuss if a change to another antibiotic is in order. (This is all ignoring the fact that for an ear infection you’d likely get an otic ear drop, not an oral suspension. Something like Neo-Poly-Dex or ofloxacin).
Unfortunately the pharmacy hellscape we’re in today leads to rushed verifications, where therapies aren’t being checked too closely and many things get missed. Pharmacies already have systems in place to warn techs and pharmacists of any interactions with recorded allergies, but if you’re traveling or need to go to a new pharmacy or doctor, things get missed.
An AI that is trained on these specific things would help alleviate some of the pressure of the already overworked pharmacy staff, while giving consise and consistent information. If a pharmacist misses an allergy or interaction, the AI could send a warning to them and the prescriber.
Note that I’m referring to job specific AI, that are trained for specific purposes. A general LLM, which it sounds like you’re referring to, would not be able to work in these environments.
Source: I audit pharmacy claims, with training in retail, LTC, and PBM pharmacy settings. It’s literally my job to catch the errors (both billing and clinical) that pharmacies make.