Woodstock Blog

a tech blog for general algorithmic interview questions

[Design] Multithreading Basics

Terminologies

Atomicity, Atomic Operation

Atomicity is unbreakability, or uninterrupted operation.

Atomic operation helps in understanding reentrancy, critical section, thread safety, synchronization primitives, etc.

Critical Section

Critical section is group of instructions/statements or region of code that need to be executed atomically.

If one thread tries to change a shared data while another thread tries to read, the result is unpredictable. It is critical to understand the importance of race condition while writing kernel mode programming.

A simple solution to critical section:

acquireLock();
Process Critical Section
releaseLock();

Synchronization primitives

Synchronization primitives are simple software mechanisms for the purposes of supporting thread or process synchronization.

Mutex, event, conditional variables and semaphores are all synchronization primitives.

Critical section is not a synchronization primitive. It’s a part of an execution path that must be protected from concurrent execution in order to maintain some invariants.

You need to use some synchronization primitives to protect critical section.

Producer–consumer

Two processes, producer and consumer. Producer thread will collect the data and writes it to the buffer. Consumer thread will process the collected data from the buffer.

Producer won’t try to add when buffer’s full and consumer won’t remove when buffer’s empty.

Solution 1: Mutex

A mutex provides mutual exclusion, either producer or consumer can have the key (mutex) and proceed with their work. As long as the buffer is filled by producer, the consumer needs to wait, and vice versa.

Solution 2: Semaphore

A semaphore is a generalized mutex. In lieu of single buffer, we can split the 4 KB buffer into four 1 KB buffers (identical resources). A semaphore can be associated with these four buffers. The consumer and producer can work on different buffers at the same time.

Interrupt service routine

Interrupt service routine (ISR), is a callback subroutine in an operating system or device driver whose execution is triggered by the reception of an interrupt.

One good example is reading from a hard drive. The drive is slow and you don’t want your OS to wait for the data to come back; you want the OS to go and do other things. So you set up the system so that when the disk has the data (ready), it raises an interrupt. In the ISR for the disk, CPU will take the data and return it to the requester.

ISRs often need to happen quickly as the hardware can have a limited buffer, which will be overwritten by new data if it’s now pulled off quickly enough.

It’s also important to have your ISR complete quickly as while the CPU is servicing one ISR other interrupts will be masked.