C.W.K.
Stream
Lesson 07 of 07 · published

When to Graduate Beyond Sequential

~8 min · sequential

Level 0Keras Apprentice
0 XP0/97 lessons0/20 achievements
0/120 XP to next level120 XP to go0% complete

The signal that you've outgrown the list

Sequential is the right tool right up until your architecture stops being a straight line — and the failure is honest: it's not that Sequential gets hard, it's that it becomes impossible. A list literally cannot express a fork. So the question isn't "is Sequential good enough?" but "does my data flow branch?" Any one of these is the signal to move on:

  • Multiple inputs — text + image, metadata + time series fused in one model.
  • Multiple outputs — e.g. a classification head and a regression head sharing a backbone.
  • Skip connections — ResNet-style residual blocks where a layer's input is added back to its output.
  • Shared layers — the same weights applied to two inputs (Siamese networks, twin encoders).
  • Any non-linear topology — anything that isn't a single unbroken chain.

The complexity ladder, not a hierarchy

Keras gives you three model-building APIs, and they form a ladder: Sequential → Functional → Subclassing. The Functional API (Track 4) covers everything above — it represents a model as a graph of layers, so forks, merges, and shared weights all become natural. When even a static graph isn't enough — you need if branches in the forward pass, dynamic shapes, or a fully custom training step — you drop to Model subclassing and write the call() method yourself.

The key mindset: each rung up buys expressiveness at the cost of boilerplate. Climbing too high wastes effort on flexibility you don't use; staying too low constrains the model you can build. Pick the lowest rung that fits your data flow — and note that "Sequential" being the bottom rung is a compliment, not a demotion. For a straight pipeline it remains the best choice in the whole library.

External links

Exercise

Sketch the data-flow diagrams for: ResNet50 (skip), U-Net (encoder-decoder skip), siamese network (shared encoder). For each, decide which API you'd use and write one sentence why.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.