You can identify an offline file by the overlay that shows an “x” character in the lower-left corner of the file icon. Instead, an “normal file” icon may display the offline files.

The icons come as a zip file containing an iContainer, OS X folders, and individual icons in ICO, ICNS, and PNG format so you should have no trouble using them anywhere.