sftwr2020

Best Algorithms Books (Part 1)

️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸

To my fellow Texans, affected by the fury of Hurricane Harvey🌀 I dedicate this essay to you, with prayers, as we go about rebuilding our homes in our Lone Star State 🚧 ⛑ ⛅ 🌂 🌈 🌝 🌞 Here’s how you can help people affected by Harvey 🎯

️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸 ️🇺🇸🇺🇸 🇺🇸 🇺🇸 🇺🇸

An algorithm must be seen to be believed 🐝
~ Donald Knuth 

We live in a culture that’s been hijacked by the management consultant ethos. We want everything boiled down to a Power Point slide. We want metrics and ‘show me the numbers.’ That runs counter to the immensely complex nature of so many social, economic and political problems. You cannot devise an algorithm to fix them 🐳
~ Carl Honore 

Nature doesn’t feel compelled to stick to a mathematically precise algorithm; in fact, nature probably can’t stick to an algorithm 🗻
~ Margaret Wertheim

According to Greek myth, Theseus was sent into a maze to kill the minotaur. Guess what, Theseus came up with an algorithm—it involves a ball of thread—to help him find his way back out again, after, of course, slaying the beast 🐉

Preamble 💙

Before We Join Our Brave Minotaur-Slayer…

Before taking even a single step forward—should we choose to accompany our intrepid friend Theseus on his quest to devise an algorithm to save his life—I am compelled to revisit a much more sobering reality on ground here in Texas 😰 Yes, two words: Hurricane Harvey… Much as I noted atop this essay, which I’m dedicating to my fellow Texans affected by the wrath of Harvey, we go about rebuilding our homes in the Lone Star State of the United States—And we need all the help we can get, and I urge you to please consider pitching in to help our brothers, sisters, children, elderly, stranded pets, etc., who have been starkly affected by Harvey 🚑 💦 🚒 🚓 💨 💔

I have poured my heart out to make this my best essay ever, if only to get your precious attention on the stark reality that faces the countless thousands in Houston and other, surrounding areas in Texas; before I went on to earn my MS from Texas A&M University (College Station)—yes I’m proud to be an Aggie—I was, and remain, a proud Houston Cougar as well. Wistfully thinking back now to my undergrad days when I was earning my BS in the presently inundated town. Yes, Houston, you were my warm home—at the same time though a decidedly drier and rather humid one at the same time, goodness—for four wonderful years 🙌

This Essay Is Going To Be Personal

I never get this personal in my essays. But then again, as in these memorable words from Charlotte Bronte’s literary masterpiece, the classic entitled Jane Eyre, and which I read ages ago as a high school student

They are, Miss Eyre, though they absolutely require a new statute: unheard-of combinations of circumstances demand unheard-of rules (italics mine)
So I came to the United States as an immigrant, and this country—my country now for nearly 30 years and to which I pledge my allegiance—embraced me with unconditional warmth. I still recall a moment when I was standing outside the University of Houston Cullen College of Engineering with a friend, and we got to talking about the city of Houston in general. Unbeknownst to me—and I have to this day not been able to fathom why—some words that my friend said continue to remain etched in my memory:
You know what Akram, Houston is a city with a big heart; it’s a town that is truly ghareeb purwur (an adjective phrase from my native language Urdu, and for which I offer an ad hoc translation: fostering and supportive the common man—and common woman, to be sure— in a nurturing way).

But First, A Tribute To The City Of Houston

Dear readers, I wish to pay a tribute to the city which embraced me as an immigrant; despite having moved back to another city (the neighboring city of Austin)—by way of South Carolina and Minnesota—the city of Houston will always have a soft spot in my heart 💝


The fury of Harvey finally subsided and we heaved a sigh of relief here. Our yards—both the front and the back—though are strewn with the wreckage of fallen tree limbs and stuff. But grateful to be safe and not flooded anymore.

Look, I’m A One-Man Shop

Much as I noted above, I’ve poured my heart out into this essay to make it my best essay ever. In the process, I taught myself how to use an image editing tool to create a handful of pictures collage to share with you. Looks, I’m a computer scientist, engineer, and programmer who designs and crafts the back-end software that powers infrastructures for Big Data and Reactive Applications—I know zilch about these fancy shmancy image editing tools, but I felt compelled to roll up my sleeves and teach myself just enough to cobble together some pictures collage to share with you.

I’m a one-man shop when it comes to this blog; there isn’t anyone editing my drafts, or helping me spiff up the formatting; so what you get on this blog is plain, straight up stuff from me 🐣 I will add, though, that it’s been my great good fortune to benefit from the advice of my friend Antonio Cangiano who has just happens to have written the definitive book on the subject of technical blogging—over the years, I’ve leaned on, and benefited tremendously from, that advice 📘

The Tracks Of My Tears 👣

You’ll want to note in particular the pics below with raindrops that symbolize just how bedraggled our existence can become when exposed to the merciless elements of nature; yes, those raindrops signify the tracks of the tears that are being shed this second as the folks in Houston recover from Harvey, struggling to pick themselves up 🌀

Reminds me of the haunting lyrics of the ethereal song Empty Garden by piano virtuoso Elton John who—along with Kishore Kumar and Mark Knopfler—is one of my all-time favorite singers. So in that angst ridden song Empty Garden, we hear Elton John soulfully and wistfully wondering as to

What happened here
As the New York sunset disappeared
I found an empty garden among the flagstones there
Who lived here
He must have been a gardener that cared a lot
Who weeded out the tears and grew a good crop
And now it all looks strange 🌘
Johnny can’t you come out to play in your empty garden 🏠
🌳 🌲 🌴 🍃 🍂 🍁

Empty Gardens, Raging Winds, And Wreckage 🚑

And speaking of the empty garden metaphor above, which we savored—in all its ascetic starkness—by way of the lyrics of Empty Garden, it’s not a random choice of images that you see here; I lavished much care on selecting each and every image, as well as their juxtaposition to achieve the desired effect. Take, for example, the collage below, where I have featured a pic I took in my own backyard—with a stowed-away pile of tree limbs that were severed from our precious live oak trees, as well as other wreckage wrought by the raging winds of Harvey. Again, though, I’m grateful to be safe and not flooded anymore. 

It’s a bizarre situation that we’ve got on our hands; we can’t pump gas into our cars, because there is no gas to be found anymore at the gas stations here in Austin. But this a mere annoyance, and utterly pales in comparison with the gut-wrenching catastrophe writ large at the moment in my dear former town: Houston 🌘
Anyone remember singer-songwriter, guitarist Mark Knopfler (of the British music group Dire Straits) singing the deeply symbolic, classic song Telegraph Road?

And my radio says tonight it’s gonna freeze
People driving home from the factories
There’s six lanes of traffic
Three lanes moving slow 

From all of these signs saying “sorry but we’re closed”
All the way down the Telegraph Road

Anyone Remember Rosie The Riveter?

So I’m going to summon just enough discipline to write up the guts of the essay now—as I’ve noted elsewhere, I do pretty much all my writing over the weekends; it’s all the more poignant that this weekend happens to be a Labor Day weekend 💪 And speaking of Labor Day, does anyone remember Rosie the Riveter? She is, of course, the cultural icon of World War II—representing the women who rolled up their sleeves and worked tirelessly in American factories and shipyards—and who rightly became a symbol of feminism and women’s economic power.

But I digress a bit, as the author of the eponymous blog is wont to, from time to time 🐝

A Bouquet To My Global Family 🌹 🌷 🌼 🌺 🌻 🌹

So before we dive into the guts of the essay proper, though, allow me to present a bouquet—an overture with which to invite you to help out those affected by Harvey, as much as for you to immerse yourself in my take on algorithms—by way of a collage of pics that I lovingly stitched together to remind us all that we’re one global family 🌷 🌻 🌹 🌼

Please know that the care I’ve lavished on knitting together the pics into a unified thematic whole is at least as much as I would give to assembling the quotes and passages I select for me essays in general. The theme of a united humanity—helping one another out during our times of need and distress—as you may well have reckoned, will be a strong undercurrent to this essay.

Raindrops (Tears?) Running Across Across The Face…

Again, we have here those selfsame raindrops running across across the face of my copy of the phenomenal book The Nature of Computation (Oxford University Press) by Cristopher Moore and Stephan Mertens; look for it in the third spot in the list of my favorite algorithms books that I’ll shortly be regaling you with. Be prepared to possibly wince, because this is a decidedly opinionated take on the very best that algorithms have to offer 🎻

A Collage (Thematic Pictures, Accompanying Legend) 🎨

The (two) pics below with raindrops running across their face symbolize just how bedraggled our existence can become when exposed to the elemental power of nature 🏈 The careful reader will have noted that those (two) pics—the ones with streaks of raindrops—have none other than the stellar book The Nature of Computation featured in them, center square

Legend to the quadrant collage [#1] of the pics above, starting with the pic in the top-left spot, and going clock-wise from there:

    1. The stellar book entitled The Nature of Computation has raindrops running across its face. 
    2. Workers in paddy fields of rice, busily earning their livelihood through physical labor. 
    3. Another view of The Nature of Computation, bedraggled, yet undaunted like The Brave Tin Soldier.
    4. A gutsy owl lifts and powers itself into a silent, stealthy flight of effortless grace.

And the legend to the quadrant collage [#2] of the pics above, starting with the pic in the top-left spot, and going clock-wise from there:

    1. A mechanical rendering of a Turing machine, an idealized computing device that laid the very foundational substrate—both conceptual and physical—for algorithms to run on. 
    2. A hedge maze, an outdoor garden labyrinth in which the walls between passages are made of hedges.
    3. Wise owls, nestled in their jaunty perch, contemplating a breakthrough algorithm to solve some particularly knotty problem, or perhaps looking into blending seemingly unrelated paradigms of programming.
    4. An aerial view of another hedge maze—this one of epic proportions—glistening in the radiance of the sun’s warmth.

Next, moving to the legend to the quadrant collage [#3] of the pics above, starting with the pic in the top-left spot, and going clock-wise from there:

    1. A sea of computers, powered by algorithms, and with their genesis of course in the brilliant mind of Alan Turing.
    2. This pic of The Nature of Computation, too, has raindrops—or perhaps tears of mournful grieving ably complemented by defiant resignation—that rip across its face.
    3. And then there is computer chess, the two-player strategy board game which encompasses both hardware and software, being capable of autonomous play without human guidance
    4. Another view of The Nature of Computation, letting drops of water slide down its face in serene resignation.

The Uncanny Role Of Circumstances In Our Lives 🐹

Let’s now bring closure to the memorable words which I had quoted at the beginning of this essay (from Charlotte Bronte’s literary masterpiece entitled Jane Eyre). Here, I’ll quote another passage from that classic, this one reminding us of the unpredictable and uncanny role that circumstances play in our lives. The heroine of the book—Jane Eyre—is engaged in a soliloquy, as she was wont to, and as we high schoolers kept discovering, much to our chagrin, way back when we were studying the prescribed book in all its undiluted glory; painfully enough, we did not have Cliffs Notes study guides back then—life-saving study aids that they are, having rightfully earned immortality in the hearts and minds of a grateful new generation of students 😭

At any rate, Jane Eyre is, in this passage, sharing a primordially elemental moment in the unraveling of the plot—or denouement as my English professor at the University of Houston was fond of saying—and we have the heroine telling us, in first person of course, how

I stopped: I could not trust myself to entertain, much less to express, the thought that rushed upon me—that embodied itself—that, in a second, stood out a strong, solid probability. Circumstances knit themselves, fitted themselves, shot into order the chain that had been lying hitherto a formless lump of links, was drawn out straight—every ring was perfect, the connection complete. I knew, by instinct, how the matter stood, before St. John had said another word: but I cannot expect the reader to have the same intuitive perception, so I must repeat his explanation (italics mine).

And finally the legend to to the quadrant collage [#4] of the pics above, starting with the pic in the top-left spot, and going clock-wise from there:

    1. Algorithms, more than anything else in the entire fabric of computer science, IMHO, evolve and thrive in the hotbed of creativity, and who better to illustrate this with than the true legend of Kekulé, who saw in a dream a snake eating its own tail, and which led Kekule—upon awaking from his dream—to the monumental discovery of the benzene molecule’s structure.
    2. Yet another view of The Nature of Computation, glistening in water drops, yet determined to let them slide away as if it’s got quite the persona of the duck’s feathers.
    3. And here you have a digression: As much as symbolizing the uncannily significant role that symbols play in programming—unerringly guided as we should be, by the compass of crafting beautiful code—I’m taking this moment to honor the memory of my father, a dedicated chemical engineer who earned his training at the University of Louisville.
    4. To round out our stroll through my kludgy collages, let’s have ourselves one last look at another pic—which I also took in my Harvey-affected backyard—of The Nature of Computation, as bedraggled as the rest of its sibling pics, yet undeterred.
Brace yourself; we’re diving now into the essay proper, as I thank you, with gratitude, for bearing with me, because I had a story that just had to be told 🐾

Algorithms Are The Stuff Of… 🎁

Technical Wizardry

Algorithms are the stuff of seemingly ethereal technological magic 🎃 Having permeated our collective consciousness—to the extent at least of having registered perceptibly in the minds of the general population—algorithms have irrevocably altered the way we live our lives. To remind us all of the centrality of algorithms to our society and culture, allow me to toss up some references here so we’re on the same page. I invite you to look up a more detailed overview elsewhere. Interestingly enough, that overview begins with the Google Search algorithm—which happened to be my suggestion, just a breath away, when I had invited you to look up further details by searching online, should you, of course, wish to do so 🐱

Yep, the very stuff of magic. As the British science fiction writer Arthur C. Clarke famously said

Any sufficiently advanced technology is indistinguishable from magic

At any rate, should you wish to navigate to a (much) more detailed overview, elsewhere, on the stuff of algorithmic magic, you’ll find a nice commentary there on—among other algorithms—these ones:

    • Google Search (There was a time not too long ago when search engines battled it out for Internet supremacy) 📌 
    • Facebook’s News Feed (As much as we may be loathe to admit it, the Facebook News Feed is where many of us love to waste our time) ⛱ 
    • NSA Data Collection, Interpretation, and Encryption (We are increasingly being watched not by people, but by algorithms) 🔐 
    • High Frequency Stock Trading (The financial sector has long used algorithms to predict market fluctuations, but they’re also being used in the burgeoning practice of high-frequency stock trading) 📈 
    • MP3 Compression (Algorithms that squeeze data are an indelible and crucial aspect of the digital world) 🔬 
    • And the list goes on and on and…. 🔭

Indeed, as J.R.R. Tolkien memorably observed in the classic book The Fellowship of the Ring

The Road goes ever on and on.

Is Software Really Eating the World?

The question is: Will algorithms remain our servants, or will they overrun as like an out-of-control juggernaut? And should you need further convincing of the juggernaut that algorithms have become, I invite you to check out the superb article Why Software Is Eating the World by Marc Andreessen—yep, the same guy who co-created the highly influential Mosaic Internet browser and cofounded Netscape. The article was originally published in The Wall Street Journal on August 20, 2011. Andreessen was spot on when he presciently noted that 📣

Today’s leading real-world retailer, Wal-Mart, uses software to power its logistics and distribution capabilities, which it has used to crush its competition. Likewise for FedEx, which is best thought of as a software network that happens to have trucks, planes and distribution hubs attached. And the success or failure of airlines today and in the future hinges on their ability to price tickets and optimize routes and yields correctly—with software.

And there is no subject in computer science—at least from a pragmatic and practitioner’s point of view—more central than that of algorithms. My fascination with algorithms, and in particular their applicability to distributed programming, would have us travel back through the mists of time; OK, just kidding, so I’m not that old 😂

Pitstops In Our Journey In The Land Of Algorithms 🚂

I will, though, be casting a glance back at my ongoing and happily endless journey through the landscape of algorithms. As I do so, I’ll be taking an opinionated look at the following books, in turn. With that, I present to you the books which have proved most helpful to me in grokking algorithms:

  1. Algorithms 4th Edition (Addison-Wesley) by Robert Sedgewick and Kevin Wayne 🏆
  2. Data Structures and Algorithms in Java 6th Edition (Wiley) by Michael T. Goodrich, Roberto Tamassia, Michael H. Goldwasser 🔔
  3. The Nature of Computation (Oxford University Press) by Cristopher Moore and Stephan Mertens 🔦
  4. Essential Algorithms: A Practical Approach to Computer Algorithms (Wiley) by Rod Stephens 📫
  5. Algorithms to Live By: The Computer Science of Human Decisions (Henry Holt and Co.) by Brian Christian and Tom Griffiths 🔐

For those impatiently trying to tell me, Hey Akram, give us the algorithms, and please make it snappy, I will oblige, and herewith submit an opinionated look at the outstanding books in the list above 📘 You have to remember, though, that I might at times be compelled to digress—may I gently remind the reader that this eponymous blog boldly proclaims the byname Programming Digressions somewhere in its title. Rest assured, thought, that those digressions won’t appear until after we’re done taking an up-close-and-personal look at these outstanding books 😇

I mean, we got to have ourselves some fun along the ride, don’t we? 🎈

Oh, and the careful reader will have noted the “(Part 1)”, um, part in the title of this essay: “Best Algorithms Books (Part 1)“. So it is that I plan on writing at least one more essay to do some justice to the finest of the abundant resources available on the subject of algorithms 🍒

1. Algorithms 4th Edition (Addison-Wesley) by Robert Sedgewick and Kevin Wayne 🏆

If you’re looking to read only a single algorithms book, look no farther than the extraordinarily well done volume that is simply entitled Algorithms 4th Edition (Addison-Wesley) by Robert Sedgewick and Kevin Wayne. I’ve gone through a ton of book on the subject of algorithms, over many years, and this gem has emerged as the clear winner 📣

Algorithms by Sedgewick and Wayne has so much that is so good, that I’ll need to break down my assessment into easily digestible chunks 🍔

This book simply can’t be beat for comprehensiveness. Yes, there is CLRS out there—it’s hoary with age and its dryness is right up there with a desiccated Saharan sand dune on an unbearably hot day—but you need to have the gumption of an archeologist to trudge across the pages of CLRS 🐫 I tossed the acronym (CLRS) out there blithely, but I might as well introduce it for newcomers to the field of algorithms: It just so happens that CLRS are the initials of this formidable book’s authors (Cormen, Leiserson, Rivest, and Stein). The book is entitled Introduction to Algorithms 3rd Edition (MIT Press) by Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein. It does make for a good research book, for finding citations and that sort of thing—for that it’s probably unbeatable—since it happens to be replete, to overflowing, with copious cross-references to the vast literature on algorithms. Given its intimidating style, though, I’m not convinced that it’s a good introductory book on the subject.

But I hear you quizzically ask, Aren’t we supposed to be talking about the Algorithms book by Sedgewick and Wayne? And right you are, except that I had to get CLRS—along with all its desiccated Saharan sand dune heft—off of my chest. So there 😇

In my mind, Algorithms is to the world of algorithms what the Gang Of Four (GoF) book is to the world of software design patterns. Yes, the former is that good, and let me tell you why. For starters, this is an incredibly polished work, much in the tradition of the highly refined GoF book; I’ll boldly venture out to say that Algorithms has set an even higher standard for what a technical book—or non-technical book for that matter—can offer to enhance the reading experience in an endearing and pleasing way. In a similar vein, you may wish to also take a peek at another awesome and incredibly well done book entitled Refactoring to Patterns (Addison-Wesley) by Joshua Kerievsky.

As you’ll come to appreciate, Algorithms is lavishly illustrated, replete with (Java) code that is pleasingly annotated at just the right level of granularity. I’ve seen other books kill trees in the process of regurgitating code snippets that leave me hanging; not this book, no sir! The more time I’ve spent with Algorithms, the more I’ve come to appreciate it as a trusted and expert personal consultant—goodness, the authors seem to have anticipated just about every question that has popped into my head as I pored over this book’s pages over the span of years.

Look, I’m a computer scientist who has been practicing the fine art of programming for over two decades. Nonetheless, we all need access to solid reference books to stay fresh and mindful of the basics. Here I find comfort in the wise words of Edward B. Burger (Southwestern University, Georgetown/Texas) and Michael Starbird (The University of Texas at Austin) who note in their slender yet rich book The 5 Elements of Effective Thinking (Princeton University Press) that

Understand simple things deeply. The most fundamental ideas in any subject can be understood with ever-increasing depth…. True experts continually deepen their mastery of the basics (italics mine).

And Algorithms is a breath of fresh air; you can even read it for sheer aesthetic pleasure 🌹

Some of you may recall Sedgewick’s Algorithms in C++. This book (Algorithms 4th Edition), though, uses Java and is, IMHO, a vast improvement over the old C++ book. It uses a sub-set of the Java object-orientation (OO) features, which actually makes the explanations flow more smoothly; in the process, this also tremendously helps in essentially side-stepping language complications that would surely have arisen had the authors chosen to go beyond using a sub-set of the Java OO features. And heaven forbid, you wouldn’t want an introductory book on algorithms to go past even that, and start looking into blending two seemingly unrelated paradigms (OO and FP) of programming, which has, though, a rightful and important place of its own in advanced aspects of program design 🐚

In sum, the authors of Algorithms use beautifully elegant and thoughtfully illustrative code throughout the book, preferring clarity over verboseness. All in all, pretty much all the essential goods on algorithms are in here, presented richly, dense—in a good condensed way—and with great taste 😎

 

2. Data Structures and Algorithms in Java 6th Edition (Wiley) by Michael T. Goodrich, Roberto Tamassia, Michael H. Goldwasser 🔔

If you’re going to read one more book on algorithms, you’ll want to make it this one: Data Structures and Algorithms in Java 6th Edition (Wiley) by Michael T. Goodrich, Roberto Tamassia, Michael H. Goldwasser.

For starters, the authors of Data Structures and Algorithms in Java succinctly round up the philosophy—in fact the very gist—of the book when they note how

The design and analysis of efficient data structures has long been recognized as a core subject in computing. 

Two standout chapters that I simply have to shout out are the following. Notwithstanding the stellar algorithms book that’s in the top spot, the treatment in Data Structures and Algorithms in Java of a couple of crucially important, thematically-related topics—(1) Maps, Hash Tables, Skip Lists, and (2) Graph Algorithms—simply knocked my socks off. You’ll find the goods on that pair of topics in chapters 10 and 14, respectively.

Consider, too, the care with which the authors explain just about everything you’ll be interested in, at least from a pragmatic standpoint 🐳 In that spirit, check out their sparkling clear coverage of the perennially important topic of Sorting with a Priority Queue. They remind us how 🏄
One application of priority queues is sorting, where we are given a sequence of elements that can be compared according to a total order relation, and we want to rearrange them in increasing order (or at least in nondecreasing order if there are ties). 

Ah, if only more writers would write with such enviable clarity and precision ✂ Thus, with helpful and unambiguous descriptions such as the example above, Data Structures and Algorithms in Java is replete with the very essence of what makes algorithms tick 💎 The language aesthete—and pragmatist—in me believes that you’ll enjoy this marvelous book. I definitely did 🎧

3. The Nature of Computation (Oxford University Press) by Cristopher Moore and Stephan Mertens 🔦

Here’s the deal: We programmers and technologists, too, need inspiration from time to time; inspiration isn’t for artists alone. Lest anyone’s jaw dropped at that observation—saying, hey we’re a cerebral and logical bunch—I will to out on a limb and say that we’re at least as much artists as logical, sentient beings, us programmers. To underscore that precise point, I’ll remind you that there’s an Art in Donald Knuth’s eponymous magnum opus entitled The Art of Computer Programming (Addison-Wesley), which is of course composed of four intense volumes 🎓

And then there is the advice to programmers by David Heinemeier Hansson—the creator of the popular Ruby on Rails web development framework—who noted in his book entitled Rework (Crown Business), which he co-authored with Jason Fried that

When Inspiration Strikes, Strike Back (in a section entitled Inspiration is Perishable)

Having made the case, I suppose, for the rightful place of inspiration, allow me to re-introduce an astonishing book—I had mentioned about it elsewhere, too, many moons ago—which is nothing short of staggering in its potential of unleashing unfettered creativity: The Nature of Computation (Oxford University Press) by Cristopher Moore and Stephan Mertens.

This book—The Nature of Computation—is precisely the one that I had in mind, earlier on in this essay, when I had shared with you the following thought, noting how

Algorithms, more than anything else in the entire fabric of computer science, IMHO, evolve and thrive in the hotbed of creativity, and who better to illustrate this with than the true legend of Kekulé, who saw in a dream a snake eating its own tail, and which led Kekule—upon awaking from his dream—to the monumental discovery of the benzene molecule’s structure 🐍
Fancy that, I’m caught quoting myself in an act of self-referential circularity; this may well invite jabs about self-referential programming magic, as of course enshrined in the fabulous meta-circular evaluator 😆 At any rate, I can’t do any better than what Moore and Mertens themselves have articulated in the splendid Preface—and there is so much that is so splendid about this book—when they share the very origins of The Nature of Computation, telling us how
This book was born in 2005 when one of us was approached by a publisher to write a book explaining computational complexity to physicists. The tale grew in the telling, until we decided—with some hubris—to explain it to everyone, including computer scientists.
For engineers, computer scientists, mathematicians, physicists, and, truth be told, for creativity connoisseurs of all stripes who are looking for a refreshing tour of the amazing intellectual fabric that underlies our universe, I can’t think of a better recommendation than a leisurely—or intensely studious and tactical—dive into the lushly cavernous pages of The Nature of Computation 🏃
Moore and Mertens have obviously lavished great care on knitting together some awesome themes of computation (think algorithms) into a unified thematic whole; I can only aspire to lavishing such care when I set about assembling the quotes and passages for these essays that I write for you ⛄ Consider, for example, these two delightful quotes which the authors use to great effect. Thus, they lead off Chapter 3: Insights and Algorithms with this enchanting quote from—yes, none other than Donald Knuth—whose magnum opus entitled The Art of Computer Programming I had mentioned just a breath away. They quote him as opining how
It has often been said that a person does not really understand something until he teaches it to someone else. Actually a person does not really understand something until he can teach it to a computer, i.e., express it as an algorithm… The attempt to formalize things as algorithms leads to a much deeper understanding than if we simply try to comprehend things in the traditional way.
~ Donald E. Knuth
Then, and in fact earlier still in The Nature of Computation, in a sub-section of the Preface that’s entitled How to read this book, they naughtily let us in on the starling secret that 🐕
Outside a dog a book is a man’s best friend. Inside a dog it’s too dark to read
~ Groucho Marx (italics mine)

Placing a marker here, as I need to revisit another peachy book by the source of the first quote above—Scott Aaronson (MIT)—which is entitled Quantum Computing since Democritus . Oh, and the money I spent on buying a copy of The Nature of Computation—and this was ages ago, or so it seems anyway—is some of the best investment I’ve ever made. Period. Expect to be repaid at an exponentially compounded rate 🚀

4. Essential Algorithms: A Practical Approach to Computer Algorithms (Wiley) by Rod Stephens 📫

Next up we have an eminently user friendly book on algorithms entitled Essential Algorithms: A Practical Approach to Computer Algorithms (Wiley) by Rod Stephens. It’s written in a pleasant and thoughtful tone, with the author neither talking down to the reader nor dumbing down the material in the least. The balance thus achieved, plus the blending of the granularity level, really hit the sweet spot for me 🍯, reminding me (albeit in a tangential way) of the following quote, from an essay elsewhere, where I was citing someone as saying that

Scala provides the tools needed to blend the object-oriented and functional programming worlds. Scala is at its best when these two evenly share a codebase. The biggest danger to misusing Scala is to ignore its object orientation or its functional programming. But combining the two is the sweet spot that the language was designed to fulfill (italics mine).

Oh, and check out the author’s endearingly smart introduction to how he came upon making the field of algorithms his own. When you get yourself a copy of this, you’ll be regaled with how 😂

Rod Stephens started out as a mathematician, but while studying at MIT, he discovered how much fun algorithms are. He took every algorithms course MIT offered and has been writing complex algorithms ever since. During his career, Rod has worked on an eclectic assortment of applications in such fields as telephone switching, billing, repair dispatching, tax processing, wastewater treatment, concert ticket sales, cartography, and training for professional football players.

Stephens aptly reminds us of the vitality and centrality of algorithms by observing that 🔧🔨🔩

Studying algorithms lets you build a useful toolkit of methods for solving specific problems. It lets you understand which algorithms are most effective under different circumstances so that you can pick the one best suited for a particular program. 

Last, but certainly not the least, I invite you to note a crucial point that Stephens make in an introductory section entitled Who This Book Is For. This will let you decide whether Essential Algorithms: A Practical Approach to Computer Algorithms is truly the right algorithms book for you.

Should you find yourself fit any part of the description above, all I can say is: Go out and grab this book; you won’t regret it; I certainly didn’t 🙇

5. Algorithms to Live By: The Computer Science of Human Decisions (Henry Holt and Co.) by Brian Christian and Tom Griffiths 🔐

Okay, so the last algorithms book we’ll be looking at today won’t actually teach you the ins and outs of algorithms in any details; in fact, not at all, at least from the implementation perspective. But I include Algorithms to Live By: The Computer Science of Human Decisions (Henry Holt and Co.) by by Brian Christian and Tom Griffiths in this list because it deserves a wide readership among those wishing to truly grok algorithms.

Algorithms to Live By will help you situate algorithms in their applicability to our personal world, and indeed to the business world as well. Dare I say, it will help answer the question that I had posed at the outset: Will algorithms remain our servants, or will they overrun as like an out-of-control juggernaut?

In the same breath—and there I had mentioned in passing the evocatively named article Why Software Is Eating the World by Marc Andreessen—I invite you again to hold on to the thought of finally deciphering the stuff of algorithmic magic. This book will tremendously aid you in grokking the bottomline of this precise area 💰

There is a lot going on in this excellent book, far more than I can do justice to at this juncture. Suffice it to say that I’m becoming increasingly and acutely aware of a startling phrase—at least that’s how the phrase grabbed me on my first encounter with it—that “Real Artists Ship”. There, in his bestseller entitled Linchpin: Are You Indispensable? (p.101), Seth Godin was reminding us of the importance that shipping a product must occupy in our collective consciousness 🚚

So it is that I will now exit, but not before an admittedly flamboyant flourish that harkens back to the 1937 Disney classic, Snow White and the Seven Dwarfs, in which the Evil Queen utters the famous line that I’m here taking the liberty of wildly paraphrasing—with a nod to Godin’s moniker that “Real Artists Ship“—by intoning

Magic mirror, on the wall—which one is the fastest shipping method of them all?

🚂 🚃 🚚 🚢 🚅

In the end—and much as I hinted at, at the outset—I invite your comments. Much more importantly, please, do please consider helping our fellow Texans affected by the fury of Hurricane Harvey. I dedicate this essay, once again, to you, fellow Texans, as we go about rebuilding our homes in the Lone Star State 🇺🇸️ Here’s how you can help those affected by Harvey 🎯

BTW, and I’ll mention this as a friendly reminder—your comments are welcomed, as always—that having read my brief take each on a handful of the finest algorithms books…

  • Did you find that your experience of reading these books was perhaps different?
  • Were there other qualities, perhaps, that I did not cover, and which happen to be the ones that you found the more helpful—in these or other books—as you mastered algorithms?
  • Did I leave out any of your favorite algorithms books?!
  • I’ve covered only a tiny fraction of the algorithms books that I’ve read, necessarily limited by the time available—stay tuned for future installments of this essay

I trust that these brief vignettes will help you in some small way along your journey to grokking algorithms 🚣

 

196 comments

  1. It’s difficult to find knowledgeable people about this subject,
    however, you sound like you know what you’re talking about!
    Thanks

    Reply

  2. I blog quite often and I really appreciate your information. The article has
    truly peaked my interest. I am going to take a note of your website and keep checking
    for new information about once a week. I subscribed to your
    Feed as well.

    Reply

  3. After I initially left a comment I seem to have clicked the -Notify me when new comments are added- checkbox and from now
    on whenever a comment is added I recieve 4 emails with the same comment.
    Perhaps there is a means you are able to remove me from that service?
    Appreciate it!

    Reply

  5. Pretty! This has been an incredibly wonderful post. Thank you for supplying this info.

    Reply

  6. This blog was… how do you say it? Relevant!!
    Finally I have found something that helped me.
    Cheers!

    Reply

  8. Good site you've got here.. It’s difficult to find high quality writing like yours nowadays.
    I seriously appreciate people like you! Take care!!

    Reply

  9. Aw, this was a very good post. Taking the time and actual effort
    to create a good article… but what can I say… I put things off a whole lot and
    never seem to get anything done.

    Reply

  10. Howdy, I do think your web site could possibly be having internet browser compatibility issues.
    Whenever I look at your website in Safari, it looks fine however when opening in IE, it's got some overlapping issues.
    I just wanted to give you a quick heads up! Aside from
    that, wonderful blog!

    Reply

  11. After I originally commented I appear to have clicked the -Notify me when new comments are added- checkbox and from now on whenever a comment is added I receive four emails with the exact same comment.
    There has to be a way you are able to remove me from that service?
    Cheers!

    Reply

  12. I would like to thank you for the efforts you have put in penning this site.
    I am hoping to see the same high-grade content from you later
    on as well. In truth, your creative writing abilities has inspired me to get my own, personal
    blog now 😉

    Reply

  13. I must thank you for the efforts you have put in penning this website.

    I am hoping to view the same high-grade content from you later on as well.
    In fact, your creative writing abilities has motivated
    me to get my own website now 😉

    Reply

  15. Next time I read a blog, Hopefully it does not disappoint
    me as much as this one. I mean, I know it was my choice to read, however
    I truly thought you'd have something helpful to talk about.
    All I hear is a bunch of crying about something you could possibly fix if you weren't too
    busy looking for attention.

    Reply

  16. Nice post. I learn something new and challenging on blogs
    I stumbleupon every day. It will always be helpful
    to read content from other writers and use something from their websites.

    Reply

  17. Oh my goodness! Awesome article dude! Thanks, However I am going through troubles with your RSS.
    I don’t know the reason why I can't join it. Is
    there anybody else having similar RSS problems?
    Anyone that knows the answer will you kindly respond?
    Thanks!!

    Reply

  18. After I originally commented I seem to have clicked
    the -Notify me when new comments are added- checkbox and now every time a
    comment is added I recieve 4 emails with the exact same comment.
    Is there a means you are able to remove me from
    that service? Kudos!

    Reply

  20. You need to take part in a contest for one of the highest
    quality sites online. I will recommend this web site!

    Reply

  21. Howdy! I could have sworn I’ve been to your blog before but
    after browsing through many of the posts I realized it’s new to me.
    Regardless, I’m definitely delighted I discovered it and
    I’ll be bookmarking it and checking back regularly!

    Reply

  22. I blog quite often and I really appreciate your content.

    This great article has truly peaked my interest. I will book mark your blog
    and keep checking for new details about once per week.
    I opted in for your Feed as well.

    Reply

  23. I blog quite often and I really thank you for your information. The article has really
    peaked my interest. I will book mark your site and keep checking for new information about once a week.
    I opted in for your Feed as well.

    Reply

  24. Hi there! This post could not be written any better! Reading through this post reminds
    me of my previous roommate! He constantly kept talking about this.

    I'll send this information to him. Fairly certain he's going
    to have a great read. Thank you for sharing!

    Reply

  25. This is a topic which is close to my heart… Best
    wishes! Exactly where are your contact details though?

    Reply

  26. You should be a part of a contest for one of the finest blogs on the internet.

    I will recommend this website!

    Reply

  27. Everything is very open with a precise description of the challenges.
    It was truly informative. Your site is extremely helpful.

    Many thanks for sharing!

    Reply

  28. But unlike other SEO companies London or elsewhere, we forge long term partnerships for long-lasting success.
    There are always product demonstrations and distinctive displays unfold through Hamleys seven dynamic floors.

    By using a service that can provide you will all of the various choices, you will save
    time and money getting online and noticed.

    Reply

  29. What i don't realize is if truth be told how you are no
    longer really much more smartly-preferred than you may be right now.
    You're very intelligent. You recognize therefore considerably when it
    comes to this subject, made me in my opinion believe it from a lot of varied angles.
    Its like men and women don't seem to be fascinated until it's one thing to accomplish with Woman gaga!
    Your own stuffs nice. All the time take care of it up!

    Reply

  30. Can I simply say what a comfort to find somebody who genuinely knows what they are discussing over the internet.
    You definitely understand how to bring an issue to
    light and make it important. More people have to look at this and understand this side of your story.
    It's surprising you're not more popular since you definitely possess the gift.

    Reply

  31. Great post! We will be linking to this particularly
    great article on our site. Keep up the great writing.

    Reply

  32. Good post. I learn something totally new and challenging on blogs I stumbleupon on a daily basis.
    It's always helpful to read content from other writers and use something from other web sites.

    Reply

  33. May I simply just say what a relief to discover someone
    who truly knows what they are discussing on the internet.
    You certainly understand how to bring a problem to light and make it important.
    More and more people ought to look at this and understand this side of the story.

    I was surprised that you're not more popular because you surely possess the gift.

    Reply

  34. Greetings! Very helpful advice in this particular article!
    It is the little changes that produce the most significant changes.
    Thanks a lot for sharing!

    Reply

  35. Having read this I thought it was rather informative.

    I appreciate you finding the time and effort to put this
    short article together. I once again find myself personally spending a significant amount of time both reading and commenting.
    But so what, it was still worthwhile!

    Reply

  36. This excellent website truly has all the information I
    wanted about this subject and didn’t know who
    to ask.

    Reply

  37. This web site certainly has all the information I wanted about this subject
    and didn’t know who to ask.

    Reply

  39. This website certainly has all of the information and
    facts I needed concerning this subject and didn’t know who to ask.

    Reply

  40. Hi, I do think this is a great web site. I stumbledupon it 😉 I may return once again since i have book marked it.
    Money and freedom is the greatest way to change, may you be rich
    and continue to help others.

    Reply

  42. This is a topic that is close to my heart… Many thanks! Exactly where are your contact details though?

    Reply

  43. Way cool! Some very valid points! I appreciate you writing this
    write-up and the rest of the website is extremely good.

    Reply

  45. Hello! I could have sworn I’ve been to your blog before but after browsing through a few of the posts I
    realized it’s new to me. Anyhow, I’m certainly happy I stumbled upon it and I’ll
    be book-marking it and checking back often!

    Reply

  46. Hi, I do think this is an excellent web site. I stumbledupon it 😉
    I will revisit yet again since I saved as a favorite
    it. Money and freedom is the greatest way to change,
    may you be rich and continue to guide other people.

    Reply

  48. I seriously love your site.. Excellent colors &
    theme. Did you make this web site yourself?
    Please reply back as I’m trying to create my own website and would love to find out where you got this from or exactly what the theme is called.
    Appreciate it!

    Reply

  49. Greetings! Very helpful advice in this particular article!
    It is the little changes that produce the most important changes.
    Thanks for sharing!

    Reply

  50. I blog frequently and I really appreciate your information.
    This great article has truly peaked my interest. I'm going to take a note of your site and keep checking for
    new details about once per week. I subscribed to your Feed as well.

    Reply

Leave a Reply to AnonymousCancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.