The four tracks on Lift Your Skinny Fists Like Antennas to Heaven consist of individually named internal movements. The album is primarily instrumental, featuring sampled voice inserts and a one-minute opening to track 4, "Moya Sings 'Baby-O'...". Samples are often used to convey satirical, political, or poetic messages. The inner panels of the vinyl edition from Constellation include a diagram illustrating the relative lengths of movements within the tracks, drawn by Efrim Menuck as rectangular blocks, with some blocks shifted upwards to indicate increased intensity. Movement titles and numerical lengths are noted above or below the squares. The same diagram is included as a paper insert in the CD edition from Kranky.

The inside cover drawings are from William Schaff's "Notes to a Friend; Silently Listening No. 2," taken from a series of small books he self-released in the late 90s and early 2000s. The cover features a redrawn version by John Arthur Tinholt of one of Schaff's pieces from that series. The flip side of the vinyl includes various photographs taken by the band.