If a field is not linked, it could only be uses to filter within its own data source.
Here is an example, showing that [Region] only filters [Sales].
And an onlinehelp link for your reference.
While working with multiple data sources in a workbook, you might want to compare the data between them using a field they have in common. To do so, you can apply a filter across multiple primary data sources.