How different would the world be if no one ever forgot anything?

Terrible. Awful. You’d probably die.
If no one ever forgot anything, that would include you. Each of us would lose the ability to block out unpleasant memories, or to remember bad things weren’t so bad. We’d go nuts and die.
Life is tough. Forget about it. Go on.