He was physicist not a politician, general, or philosopher. He is also the one who convinced President Roosevelt to build the bomb, not very consistant with the quote.
I think I would prefer Teddy Roosevelt's quote:
"Speak softly and carry a big stick;"
Actually when he came up with his Theory of Special Relativity, he was a patent clerk, not a physicist (although he was trained as one.)
He also said:
"I am not only a pacifist but a militant pacifist. I am willing to fight for peace. Nothing will end war unless the people themselves refuse to go to war."
And I will strongly disagree with your assertion that he was not a philosopher. He was one of humankind's best philosophers IMHO.
For instance:
"I believe that a simple and unassuming manner of life is best for everyone, best both for the body and the mind. "
"I do not believe in immortality of the individual, and I consider ethics to be an exclusively human concern with no superhuman authority behind it."
"I do not believe in the God of theology who rewards good and punishes evil."
"If people are good only because they fear punishment, and hope for reward, then we are a sorry lot indeed."
"Intellectual growth should commence at birth and cease only at death."
"Nationalism is an infantile disease. It is the measles of mankind."
"Only a life lived for others is a life worthwhile."
"Reality is merely an illusion, albeit a very persistent one."
"Science without religion is lame, religion without science is blind."
"The difference between stupidity and genius is that genius has its limits.
"The only reason for time is so that everything doesn't happen at once."
"The world is a dangerous place to live; not because of the people who are evil, but because of the people who don't do anything about it."
"There are two ways to live: you can live as if nothing is a miracle; you can live as if everything is a miracle."
And my favorite Einstein quote:
"Only two things are infinite, the universe and human stupidity, and I'm not sure about the former."
If that is not philosophy, what is it?
All quotes courtesy of
http://www.brainyquote.com. And there are lots more where they came from.