I’m just saying...
It's usually said right after something that could be interpreted as insulting or accusatory, such as:
"Someone sure made a mess in here!"
"Are you saying I'm a slob?"
"I'm just saying..."
The first person makes a comment that is ambiguous and can be interpreted in several ways. This causes the second person to ask for clarification, lest he respond inappropriately. However, given the opportunity to clarify, the first person responds with "I'm just saying", implying that it was merely an observation, a statement of incontrovertible fact "Someone made mess in here." Of course that begs the question, "Why did he make make this observation?" Was this a startling revelation not readily apparent? Did he just conclude that the mess was man made, and not a natural phenomenon? Either way, why not clarify his intent?
Instead he hides behind the pretext of stating apparent facts, and refuses to enter into a healthy dialogue. He deceives himself into thinking that he has made his point of slovenliness, while still having plausible deniability, which fools no one. Instead of diffusing the situation it inflames it.
This phrase needs to be banished from our conversations, assuming of course, that we want to improve our relationships.