Everyday experience suggests that sleep and affect are closely linked, with daytime affect influencing how we sleep, and sleep influencing subsequent affect. Yet empirical evidence for this bidirectional relationship between sleep and affect in non-clinical adult samples remains mixed, which may be due to heterogeneity in both construct definitions and measurement. This conceptual review proposes a granular framework that deconstructs sleep and affect findings according to three subordinate dimensions, namely domains (which are distinct for sleep and affect), methods (i.e., self-report vs. behavioral/physiological measures), and timescale (i.e., shorter vs. longer). We illustrate the value of our granular framework through a systematic review of empirical studies published in PubMed (N = 80 articles). We found that in some cases, particularly for sleep disturbances and sleep duration, our framework identified robust evidence for associations with affect that are separable by domain, method, and timescale. However, in most other cases, evidence was either inconclusive or too sparse, resulting in no clear patterns. Our review did not find support for granular bidirectionality between sleep and affect. We suggest a roadmap for future studies based on gaps identified by our review and discuss advantages and disadvantages of our granular dimensional framework.