Sounds like boost creep caused by the manifold since the actuator is working without a problem. But then again it could be a few things. Are you running an electronic boost control solenoid?