Setting up your first business can be daunting if you don't do your research first.
The Ministry of Business, Innovation and Employment have useful information for you to consider before you get set up.
This includes:
Information on different types of business structures;
Information on naming your new business;
Information on registering your new business with the companies office
You can find all of this information here:
http://www.business.govt.nz/starting-and-stopping/entering-a-business/starting-a-business
Inland Revenue have also developed a number of tools to assist you to set up a new business (and to ensure that you are meeting your tax obligations). Check them out here:
http://www.ird.govt.nz/tool-for-business/?id=201405MegaMenu
Information on Business Grants can be found here:
http://www.business.govt.nz/support-and-advice/grants-incentives
http://www.nzfundinggrants.org/