Well, after fixing my wordpress file permission. I found that I cannot install plugins from wordpress portal.
I have to set www-data as owner for every file
chown -R www-data:www-data *
But some people suggest that it will be dangerous to do that.
All right, I will set the owner back to root once I finished the plugin installation.