Fractal generation not fitting in expected range

Here's a problem description for generating a fractal:

test

If anyone has any insight into this problem and what I'm conceptually getting wrong it would be of great help. Thanks!