No, you don't have to pay to use the website.
D&D Beyond is committed to allowing you to use this service, including the character creator and other tools, free of charge. The only restriction within that is that you only have access to the rules freely distributed by Wizards of the Coast.