So, this morning I asked Claude to process this AM’s SECO update (incorporating the UNSC’s August 14th updates), and it told me that it looked awfully like yesterday’s SECO update – and would I like to update that post, or create a new one.

Yes, on both days, 3 persons and 1 entity were updated by the UNSC. And SECO created an update for each. Because of the timing of the 2 updates, OFSI actually issued a single update on Monday comprising of both sets of UN updates. Even there, OFSI said there were 6 updates to individuals and 2 to entities… which confused Claude, even if it was technically true, from a. regulatory standpoint.

It’s a good reminder of the limitations, especially over time, of AI tools’ ability to understand context. Would Claude have not been confused had I used a more powerful model like Opus or Fable instead of Sonnet? Perhaps, but at what cost – those models chew up your usage a lot faster, which is silly for normal day-to-day work.

Thought this was an interesting case to share.