This book provides foundations for the understanding and design of computation-efficient algorithms and protocols for those interactions with environment, i.e., wireless communication systems. The book provides a systematic treatment of the theoretical foundation and algorithmic tools necessarily in the design of computation-efficient algorithms and protocols in stochastic scheduling. The problems addressed in the book are of both fundamental and practical importance. Target readers of the book are researchers and advanced-level engineering students interested in acquiring in-depth knowledge on the topic and on stochastic scheduling and their applications, both from theoretical and engineering perspective.