We've enabled Apache's mod_deflate on our drupal site. From there let's start, we're realizing that CSS files aren't getting loaded correctly. It does not happen each time. Kinda random.

Did other people notice this problem? If that's the case, any recommended solutions?

You may have better luck using the CSS Gzip module than doing the work with Apache directly.