Network data can be conveniently modeled as a graph signal, where data values are assigned to nodes of a graph that describes the underlying network topology. Successful learning from network data is built upon methods that effectively exploit this graph structure. Graph neural networks (GNNs) are one such method that has exhibited promising performance. Understanding why GNNs work so well is of paramount importance, particularly in applications involving physical networks. We focus on the property of discriminability and establish conditions under which the inclusion of pointwise nonlinearities to a stable graph filter bank can potentially lead to an increased discriminability of high-eigenvalue content. We define a notion of discriminability tied to the stability of the architecture, show that GNNs are at least as discriminable as linear graph filter banks, and characterize the signals that cannot be discriminated by either.