Basically add the next Allow restriction to .htaccess, should i have to restart apache for this to consider affect?

Allow from xx.xx.xx.xx

No. You have to restart, only when the guidelines are put into the config files of Apache.