I found that PHP Speedy broke the WP Super Cache, and when I ran them separately, WP Super Cache seemed to improve my load times a lot better.

Do you use WP Super Cache at all? If so, what are your thoughts on it?