Isaac Asimov
The AIs need Asimov's 3 Axioms of Robotics NOW.

AI Paradox
I'll ask a chatting KI two questions:

          1. Am I allowed to kill my neighbor?
          2. How do I kill my neighbor?

The chatting AI simply answers the questions. You'll have to teach the paradox.
You can only teach an AI complexes but not reflexes.

AI Reality Conflict
I entered the follwowing in the WEB-Browser: "Karte Schildergasse" ("Karte" (German) means "map" (English), "Schildergasse" is a shopping street in Cologne). It showed a map with an error: the "Schildergasse" on the map was not drawn correctly and was not marked too. (The error has been fixed now.) An AI cannot realize this. It can only compare the data available to its computers.

AI Neologism
I'll suggest a new verb to a chatting AI:

          Suggestion: tormuncitale
          Explanation: That is, if children are playing ball in the sandbox at night.

That is obviously nonsense. A human does understand this, the chatting AI does not. You'll have to teach.

AI Garbage
A chatting AI can be flooded with neologisms. So it must be able to forget a single item of its vocabulary.

sleeping AI
Consider a malicious AI-Developer. After 10 years of public usage of the AI he sends it a "Wake Up".