Network Watcher in Azure

Network Watcher in Azure

A friendly, thorough guide to the toolbox that lets you see, test, and record what is happening inside your Azure networks: how to find out why a connection fails, how to watch traffic over time, and how to keep the costs and the risks under control.

Imagine a large office building where one door suddenly refuses to open. Nobody knows why. Is the lock broken? Is the keycard wrong? Is the corridor blocked? Is the guard at the desk turning people away? Without a way to look inside the building, you would walk around guessing, trying doors one by one, and wasting hours.

Now imagine the building has a control room. A technician can check any door, trace any corridor, look at the guard’s rule book, replay the camera footage, and print a report of who went where. Problems that took a day to find now take minutes. That control room is what Network Watcher is for your Azure networks.

In this guide you will learn what Network Watcher is, the words around it, and the tools inside it. You will learn how to test a connection, trace a route, capture packets, record traffic, turn records into pictures, set alerts, and control the cost. No earlier knowledge is required, and each new word is explained when it first appears.

1What Is Azure Network Watcher?

Network Watcher is a collection of tools in Azure for monitoring, diagnosing, and understanding the networks you have built, so that you can find problems faster and see what your network is really doing.

Start with what a network does

A network moves messages between computers. When you run applications in Azure, many pieces must talk to each other: web servers, databases, load balancers, gateways, and offices far away. Each message passes through addresses, rules, routes, and devices. If any one of these is wrong, the message does not arrive, and the person using the application sees only a slow page or an error.

Why seeing is hard

In your own office, you could walk to the cable room and look. In the cloud, you cannot. The cables, switches, and routers belong to Microsoft, and you work only with software versions of them. You need tools that look inside the virtual network on your behalf and tell you what they find. Network Watcher is that set of tools.

What it gives you

  • Diagnosis. Tools that answer questions like “Why can machine A not reach machine B?” and name the exact rule or route responsible.
  • Visibility. A drawn picture of your network and records of the traffic that crossed it.
  • Monitoring. Tests that run on a schedule and tell you when delay, loss, or reachability change.
  • Evidence. Packet captures and logs that experts and auditors can examine later.
  • Insight. Analysis of flow records to show who talks the most, what is blocked, and where traffic goes.
Analogy

Think of Network Watcher as the detective kit and security camera room of your network. The detective tools answer a single question right now. The cameras record what happened so that you can review it afterwards. Together they let you move from guessing to knowing.

1
Network Watcher per region, per subscription
0
agents needed for most of the diagnostic tools
3
kinds of help: diagnose now, monitor over time, and record for later
i
Remember this

Network Watcher does not change your traffic. It observes and tests. That is why it is safe to use on live systems, with a few exceptions such as packet capture, which needs care because it records real data.

2Why Network Watcher Exists

Cloud networks are built from software settings, and software settings are easy to get wrong. A tool that explains what the settings actually do is not a luxury.

The problem of many layers

A single message in Azure may pass through a security group on a subnet, another on a network interface, a route table, a firewall, a gateway, and a load balancer. Each of these may allow, block, or redirect the message. When something fails, the cause could be in any layer. Reading all the settings by hand takes a long time and people miss things.

The problem of invisible failures

Some failures never produce a clear error message. A rule blocks traffic silently. A route sends traffic into a dead end. A DNS name resolves to the wrong address. The application simply waits and times out. You need a tool that can say “this specific rule dropped this specific packet” instead of leaving you to work out the reason.

The problem of change over time

Networks that worked yesterday can fail today because someone changed a rule, a link became slow, or traffic patterns shifted. Without records, you cannot answer simple questions such as “When did this start?” or “What changed?” Logs and monitoring give you a memory.

Analogy

A pilot flies with instruments and a flight recorder. The instruments show what is happening now, and the recorder keeps the history in case something goes wrong. A cloud network without diagnostics is like flying blind with no black box. Network Watcher supplies both.

What it solves in practice

“Why can I not connect?”

Test one specific connection and see which rule, route, or device stops it, instead of reading every setting.

“Is my network slow?”

Run tests that measure delay and packet loss between two points and keep the results as a graph over days and weeks.

“Who is talking to my database?”

Use flow records to list the machines and ports that connected, and spot connections that should not exist.

“What exactly was sent?”

Capture packets on a machine and examine the conversation in detail, when the higher-level tools do not give the answer.

You cannot fix what you cannot see.

3Core Concepts and Vocabulary

Network Watcher uses ordinary networking words and a few of its own. Learn them once, and the documentation will read easily.

The service

Network Watcher

The Azure service that holds the monitoring and diagnostic tools for networks in a region.

Packet

Packet

A small chunk of data sent across a network. Every message is cut into packets that travel separately and are put back together at the end.

Flow

Flow

A single conversation between two endpoints, described by source address, source port, destination address, destination port, and protocol.

Five items

Five-tuple

The five facts that identify a flow: source address, source port, destination address, destination port, and protocol.

Rules

Network security group

A list of allow and deny rules that filters traffic at a subnet or network interface.

Path

Route table

A list of directions that tells traffic which way to go to reach a destination.

Next stop

Next hop

The very next device or gateway a packet is sent to on its way to its destination.

Speed

Latency

The time a message takes to travel from one point to another. Lower is better.

Loss

Packet loss

The share of packets that never arrive. Even small loss can slow applications.

Records

Flow log

A recorded list of flows that crossed a network, including whether they were allowed or denied.

Charts

Traffic Analytics

A feature that turns flow logs into charts and tables inside Log Analytics.

Storage

Log Analytics workspace

A place where logs and metrics are stored and searched with a query language.

Test

Connection Monitor

A tool that sends test traffic between points on a schedule and records delay, loss, and reachability.

Agent

Network Watcher extension

A small program added to a virtual machine for features that must run inside the machine, such as packet capture.

Name book

DNS

The system that turns names into addresses. Many network faults are really name faults.

Heartbeat

Service tag

A named group of addresses kept up to date by Azure, used in rules instead of long lists.

The five-tuple in plain words

Most diagnostic tools ask you for the same five facts. Where is the traffic coming from? On which port? Where is it going? On which port? And is it using TCP or UDP? Together these describe one conversation exactly. When you ask Network Watcher “would this be allowed?”, you hand it these five facts, and it replies with a clear yes or no and the rule behind the answer.

Analogy

A courier parcel needs a sender address, a sender room, a receiver address, a receiver room, and a delivery method. If you give all five, the post office can tell you exactly what will happen to it. If one is missing, the answer is a guess. The five-tuple is the same idea for network traffic.

TCP and UDP

These are the two main ways of sending data. TCP is careful: it sets up a connection, numbers the packets, and resends any that go missing. Web pages and databases use it. UDP is quick and careless: it just sends, with no checking, which suits live voice, video, and some name lookups. Network Watcher tests need you to say which one you mean.

4Architecture and Components

Network Watcher is not a single program. It is a family of tools that look at different parts of your network and send their results to different places.

flowchart TD
    subgraph NET["Your Azure Network"]
        VM1["Virtual Machine A"]
        VM2["Virtual Machine B"]
        NSG["Network Security Groups"]
        RT["Route Tables"]
        GW["VPN or ExpressRoute Gateway"]
    end
    subgraph NW["Network Watcher in the Region"]
        DIAG["Diagnostic tools: IP flow verify, next hop, connection troubleshoot, NSG diagnostics"]
        MON["Monitoring: Connection Monitor and topology"]
        CAP["Packet capture"]
        FL["Flow logs"]
    end
    NSG --> DIAG
    RT --> DIAG
    VM1 --> MON
    VM2 --> MON
    VM1 --> CAP
    NET --> FL
    FL --> ST["Storage account"]
    FL --> LA["Log Analytics workspace"]
    LA --> TA["Traffic Analytics charts"]
    MON --> LA
    CAP --> ST
    LA --> AL["Alerts and dashboards"]
    GW --> DIAG
    
Figure 1: Where Network Watcher tools look and where their results go

Read the diagram from the top. Your network contains machines, security groups, route tables, and gateways. Network Watcher has four groups of tools. The diagnostic tools read the rules and routes to answer questions on demand. The monitoring tools run tests between machines on a schedule. Packet capture records data on a single machine. Flow logs record every conversation across the network. Results land in a storage account or a Log Analytics workspace, where charts, alerts, and dashboards can use them.

The on-demand tools

These answer one question when you ask it. You give the details, they check the configuration, and they reply within seconds. They do not need to stay running, and most do not need anything installed on your machines.

The continuous tools

Connection Monitor and flow logs work all the time. They produce a steady stream of results that build a picture of how the network behaves over days and weeks. They cost money while they run, because they produce data that must be stored and processed.

The capture tool

Packet capture works inside a virtual machine and requires an extension. It records actual packets, which is powerful and sensitive. It is used for hard problems, for short periods, and with care.

Where the data goes

DestinationHoldsUsed for
Storage accountRaw flow log files and packet capture filesCheap long-term keeping and later downloads
Log Analytics workspaceProcessed logs and monitoring resultsQueries, charts, alerts, and Traffic Analytics
Azure MonitorMetrics and alert rulesNotifying people when something changes
Event hub or partner toolsStreams of log eventsSending data to outside security or analysis products
Analogy

Imagine a building with an inspector who answers questions on demand, a patrol that walks the corridors every five minutes, a camera that records one particular room, and a visitor book at every entrance. The reports from all four go to a filing room and a records office. The inspector, the patrol, the camera, and the visitor book are Network Watcher’s four groups of tools.

i
Start small

You do not need every tool on day one. Begin with the on-demand diagnostic tools, which are free of extra cost, and add monitoring and logging as your needs and budget grow.

5Enabling Network Watcher: Regions, Resource Groups, and Permissions

Before you can use any tool, Network Watcher must exist in the region where your network lives. Understanding how this works avoids a common confusion for beginners.

One per region, per subscription

Network Watcher is a regional service. In each subscription, there can be one Network Watcher resource for each Azure region. If your virtual networks are in three regions, you need Network Watcher enabled in all three. A virtual network in East US is served by the Network Watcher in East US, not by one in another region.

Automatic enabling

When you create or update a virtual network in a subscription, Azure normally enables Network Watcher for that region automatically. The resource is placed in a resource group named NetworkWatcherRG, which Azure creates for you. Many people are surprised to find this group in their subscription. It is expected, and it is safe to leave alone. Deleting it removes the Network Watcher resources inside it.

Organizations can choose to turn off automatic enabling and create the resource in a resource group of their own choice, which fits better with naming and governance rules. Check current documentation for the exact steps and behaviors, since they have changed over time.

Analogy

Each branch of a bank has its own security office. When a new branch opens, the head office sets up the security office automatically and puts it in a standard room. You can ask for the room to be elsewhere, but every branch needs one.

Permissions

Network Watcher uses Azure’s role-based access control. A person needs a role that allows them to read and run its tools. The built-in Network Contributor role is often used, and custom roles can grant only what is needed. Some tools need extra permissions on other resources too. For example, flow logs must be able to write to a storage account, and packet capture must be able to install an extension on a machine.

  • Read-only staff can view topology and effective settings.
  • Network engineers run the diagnostic tools and create monitors.
  • Security staff read flow logs and analytics.
  • Only a few trusted people should start packet captures, since they can record sensitive data.

What you need on the machines

ToolNeeds something on the virtual machine?
Topology, effective rules, effective routesNo
IP flow verify, NSG diagnostics, next hopNo
Connection troubleshootYes, the Network Watcher extension on the source machine
Connection MonitorYes, an agent on the source machines, with options depending on the kind of source
Packet captureYes, the Network Watcher extension
Flow logsNo; configured on the network, not on the machine

Agent requirements and options have changed between versions of the service, so confirm them in the current documentation before you plan a rollout.

!
Watch the region

If a tool says that Network Watcher is not found, check the region first. A resource in one region cannot be diagnosed by the Network Watcher of another. This is the most common first-day mistake.

6Seeing the Network: Topology and Effective Settings

The first job of any troubleshooter is to understand what is actually there. Network Watcher offers views that draw the network and show the settings that really apply.

Topology

The topology view draws your virtual network as a diagram. You see subnets, network interfaces, security groups, route tables, load balancers, gateways, and how they connect. It is built from the live configuration, not from someone’s old drawing, so it always shows what exists now. It is a good way to take over a network you did not build, or to explain a design to others.

Analogy

Topology is the building floor plan that is automatically redrawn every time someone moves a wall. You never have to ask whether the plan is out of date.

Effective security rules

A network interface may be covered by a security group on the subnet and another on the interface itself. Reading both and combining them in your head is error-prone. The effective security rules view does the combining for you. It lists every rule that applies to a network interface, in the order they are checked, from every group that touches it. This answers the question, “Given everything attached here, what is really allowed?”

Effective routes

The same idea applies to routing. Azure combines the built-in system routes, any routes you added in a route table, and routes learned from gateways. The effective routes view shows the final merged list for a network interface. It tells you, for any destination, which route wins and where the traffic will go next.

How to read the effective routes

1

Find the destination range

Look for the line whose address range contains the address you want to reach.

2

Prefer the most specific line

Azure chooses the route with the longest prefix, which means the narrowest matching range, so a small range beats a big one that includes it.

3

Check the source of the route

The list shows whether the route is a default, one you made, or one learned from a gateway. When ranges are equal, your own routes beat gateway routes, which beat the defaults.

4

Read the next hop

The next hop type tells you where the traffic goes: within the network, to the internet, to a gateway, to a firewall address, or nowhere at all.

Why these views matter

  • They remove guesswork about which setting wins.
  • They expose rules or routes that people forgot they created.
  • They show the effect of gateways that add routes automatically.
  • They give a clear screenshot or export to share in a support ticket.
i
One limit

Effective settings are shown for a network interface that is attached to a running virtual machine. If the machine is stopped, the view may be empty. Start the machine before you expect to see the full picture.

7The Core Diagnostic Tools: IP Flow Verify, NSG Diagnostics, and Next Hop

These tools answer the most common question in networking: why does this specific connection not work? They check your settings in seconds and name the exact cause.

sequenceDiagram
    participant U as You
    participant NW as Network Watcher
    participant S as Security Rules
    participant R as Routes
    U->>NW: Is traffic from VM A to 10.0.2.4 port 1433 using TCP allowed?
    NW->>S: Read the rules that apply to VM A outbound
    S-->>NW: Outbound allowed by rule AllowVnetOutBound
    NW->>S: Read the rules that apply to the target inbound
    S-->>NW: Inbound denied by rule deny-sql-from-web
    NW-->>U: Denied. The blocking rule is deny-sql-from-web
    U->>NW: Where would traffic from VM A to 10.0.2.4 go next?
    NW->>R: Look up the most specific matching route
    R-->>NW: Next hop type is VnetLocal
    NW-->>U: The packet stays inside the virtual network
    
Figure 2: How IP flow verify and next hop answer a question about one connection

The diagram shows two typical questions. First you ask whether a particular kind of traffic is allowed. Network Watcher reads the rules in both directions and tells you the verdict and the name of the rule responsible. Then you ask where the traffic would go next, and it reads the routes and reports the next hop. Together, the two answers cover the two biggest causes of connection trouble: filters and paths.

IP flow verify

IP flow verify checks one specific flow against the security rules of a virtual machine’s network interface. You supply the direction, protocol, local and remote addresses, and ports. It replies “Access allowed” or “Access denied”, and it names the rule that decided. It looks at the real, combined rules, including those from security groups on both the subnet and the interface.

  • It checks only security rules, not routes, firewalls outside the group, or the machine’s own firewall.
  • A result of “allowed” does not prove the connection works; it only proves Azure’s rules are not the cause.
  • It is best for quick yes-or-no questions about a single flow.

NSG diagnostics

NSG diagnostics goes a step further. Instead of one machine’s interface, it examines a flow across all the security groups that apply, and shows how each group treats it. It can even evaluate flows described through service tags or address ranges, which is useful for checking a rule change before you make it, or for finding out which groups are responsible. Its availability and features have been changing, so check current documentation.

Next hop

Next hop tells you where a packet leaving a machine will be sent first on its way to a destination. The answer includes the type of hop and, when relevant, the address of the device. The common types are:

Next hop typeWhat it means
VnetLocalThe destination is inside the same virtual network
InternetTraffic goes out to the public internet
VirtualNetworkGatewayTraffic goes to a VPN or ExpressRoute gateway
VirtualApplianceTraffic goes to a firewall or router that you run, at the address shown
VNetPeeringTraffic goes to a peered virtual network
NoneTraffic is dropped because the route points nowhere

Next hop also reports which route table entry made the decision. This is how you catch a user-defined route that sends traffic somewhere unexpected, or a missing route that leaves it stuck with the default.

Analogy

IP flow verify is like asking the building guard, “Would you let a person with this badge enter this room?” Next hop is like asking, “From the lobby, which corridor would this person be sent down first?” The guard checks the rule book; the corridor map checks the path. Many problems need both questions.

!
Do not stop at “allowed”

If IP flow verify says traffic is allowed and the connection still fails, the cause is elsewhere: a route, a firewall appliance, the machine’s own firewall, the application not listening, or DNS. Move to the next tool instead of rechecking the same rules.

8Connection Troubleshoot

The tools in the last chapter read settings. Connection troubleshoot goes further: it actually tries to connect, and tells you what happened along the way.

What it does

Connection troubleshoot sends real test traffic from a virtual machine in Azure to a destination, such as another machine, a name on the internet, or an address on a given port. While doing so, it measures how long the trip takes, records each hop on the path, and checks whether the connection succeeded. It also looks for configuration problems on the way and reports them, such as a blocking security rule or a route that sends traffic nowhere.

What you provide

  • Source: a virtual machine in Azure that has the Network Watcher extension installed.
  • Destination: an address, a name, or another Azure resource.
  • Port and protocol: for example TCP on port 443.

What you get back

Verdict

Reachable or not

A simple answer on whether the connection could be made.

Timing

Latency numbers

Minimum, average, and maximum round-trip times for the probes.

Path

Hop list

The devices the traffic passed through on the way, each with its own address.

Cause

Issues found

Problems detected on the route, with the rule or setting responsible and a suggested direction to fix.

Analogy

The earlier tools are like reading the road signs and the speed limits. Connection troubleshoot is like sending a test driver along the route to see if the trip really works, how long it takes, and where the trip stops if it does not. It is a real test, so it can find problems that no one wrote in a setting.

Typical uses

  • Testing that a web server can reach its database before the application goes live.
  • Confirming that a machine can reach a service on the internet through a NAT gateway or firewall.
  • Finding where traffic stops on the way to an on-premises server through a gateway.
  • Checking delay between two machines in different regions.

Limits and changes to know about

Because it sends real traffic, it needs the extension on the source machine and permission to run. It is a point-in-time test, so a problem that happens only sometimes may be missed. For continuous testing, the better tool is Connection Monitor, explained in the next part of this guide. Microsoft has been moving the features of connection troubleshoot toward Connection Monitor, so check current documentation to see whether you should start with one or the other.

i
A good first test

When a new connection fails, run connection troubleshoot early. The hop list and the named problem often explain the failure in one step, saving you from running several separate checks.

9Connection Monitor

A single test tells you what is true right now. Connection Monitor repeats tests all day and every day, so you can see trends and catch problems that come and go.

What it is

Connection Monitor is the continuous testing tool of Network Watcher. You define a set of sources, a set of destinations, and the tests to run between them. It then sends probes on a schedule, measures the results, and stores them. You can view the history as graphs, see which paths are healthy, and set alerts when something crosses a limit.

The building blocks

From

Test groups

A bundle of sources, destinations, and test settings that belong together. One monitor can hold several groups.

Where from

Sources

Azure virtual machines or scale sets, and on-premises machines with the monitoring agent installed.

Where to

Destinations

Azure machines, on-premises machines, or external addresses such as a public website.

How

Test configurations

The protocol (TCP, HTTP, or ICMP), the port, how often to test, and the limits for success.

Pass or fail

Thresholds

The percentage of failed checks and the round-trip time above which a test is called unhealthy.

Store

Workspace

A Log Analytics workspace that keeps the results for charts and queries.

What it measures

  • Reachability: whether the destination answers at all.
  • Round-trip time: how long a probe takes to go and return.
  • Check failures: the percentage of probes that did not succeed.
  • Path topology: a hop-by-hop view that can show where on the path the delay or loss begins.
Analogy

Connection Monitor is a postman who walks the same delivery route every five minutes, noting how long each stretch takes and whether each house answers the bell. After a week, you do not just know that a house was closed; you know that it is closed every evening at six, which is far more useful.

Why it beats one-off tests

Strengths

  • Finds problems that appear only at certain times
  • Builds a history for comparing before and after a change
  • Covers cloud, hybrid, and internet paths in one view
  • Raises alerts without anyone running a test

Things to remember

  • Needs agents on the source machines
  • Costs grow with the number of tests and how often they run
  • Probes are samples, so very short problems may slip between them
  • Results depend on well-chosen thresholds

The older tool it replaced

Earlier, Azure had separate tools called Network Performance Monitor and the older classic connection monitor. Microsoft has retired them and pointed users to the current Connection Monitor. If you read older articles that describe those tools, treat them as history and check the current documentation for migration notes.

Choosing what to test

Do not test everything. Pick the paths that matter most to the business: the web tier to the database, the office to the application over the VPN or ExpressRoute, the application to its key outside partner. A small number of well-chosen tests with sensible alerts is more useful than hundreds of tests that nobody reads.

i
Name tests for people

Give every monitor and test a clear name that describes the path and the purpose, such as “office-to-erp-over-expressroute”. At two in the morning, a clear name saves minutes of confusion.

10Packet Capture

When the higher-level tools cannot explain a problem, packet capture lets you look at the actual data passing through a machine’s network card, packet by packet.

What it does

Packet capture records the packets that enter and leave a virtual machine’s network interface. It works through the Network Watcher extension on the machine. You choose how long to record and how much to keep. The recorded data is saved in a file in a storage account or on the machine itself. You then open the file with a tool that reads capture files and examine each packet, its addresses, its flags, and its timing.

When to use it

  • A connection starts but stalls partway, and you need to see who stopped answering.
  • You suspect a device is resetting connections or changing packets.
  • An application complains about corrupted or missing data.
  • You need evidence for a vendor or a security investigation.
  • You want to confirm exactly which addresses and ports an application really uses.
Analogy

If connection troubleshoot is a test drive, packet capture is a dashcam recording the whole journey frame by frame. You can pause, rewind, and read the number plate of every car. It shows everything, so it is powerful, and also for that reason it must be handled carefully.

Filters keep it manageable

A busy machine produces enormous numbers of packets. Without filters, the capture grows quickly and becomes hard to read. You can restrict the capture to chosen protocols, source and destination addresses, and ports. You can also limit the number of bytes kept from each packet, and set a maximum file size and time limit. Narrow captures are faster to analyze and safer to store.

Steps for a good capture

1

State the question

Decide what you hope to learn. “Why does the connection to port 1433 reset after ten seconds?” is a better start than “capture everything”.

2

Set filters and limits

Choose addresses, ports, protocol, a maximum duration, and a size cap.

3

Start, reproduce, and stop

Start the capture, trigger the problem, and stop the capture as soon as you have it.

4

Analyze

Open the file in a packet analyzer. Look for resets, retransmissions, long gaps, or missing replies.

5

Protect and delete

Store the file securely, share it only with those who need it, and delete it when the case is closed.

Limits to remember

  • It captures on one machine at a time, so a full picture may need two captures at both ends.
  • Encrypted traffic shows addresses and timing, but not readable content.
  • There is a maximum duration for a single session, which you should check in current documentation.
  • It needs the extension installed, and the machine must be running.
!
Privacy warning

Captures can contain passwords, personal data, and business secrets in unencrypted traffic. Restrict who can start them, keep the files in protected storage, and follow your organization’s rules on handling such data.

11VPN and Gateway Diagnostics

Connections between Azure and your offices rely on gateways. When a tunnel drops or never comes up, Network Watcher can look inside the gateway for you.

VPN troubleshoot

The VPN troubleshoot tool checks the health of a VPN gateway and its connections. You select the gateway or a single connection and give it a storage account. The tool runs a series of checks and writes a detailed report and log files. It looks for problems such as mismatched settings, failed negotiation, expired keys, or a stopped gateway. The report names likely causes and suggests where to look next.

  • It works for both gateways and individual site-to-site connections.
  • It gives a health status, such as healthy or unhealthy, and a summary of what was found.
  • Log files can be downloaded to share with a network team or with support.

What commonly goes wrong with tunnels

ProblemWhat it looks likeUsual cause
Tunnel never connectsStatus stays “connecting” or “not connected”Mismatched keys, encryption settings, or addresses; on-premises device not reachable
Tunnel drops now and thenConnection flaps up and downUnstable internet, device restarts, or differing lifetimes of keys
Tunnel up but no trafficConnection shows connected, applications failMissing routes, overlapping address ranges, or blocking rules
Slow trafficHigh delay or low speedGateway too small, congested internet link, or large packets being split
Gateway unhealthyTroubleshoot reports a failed statePlatform issue, a recent change, or a stopped resource
Analogy

A VPN tunnel is a private bridge between two cities. VPN troubleshoot sends an inspector onto the bridge to look at the supports, the toll gates at both ends, and the road surface. The inspector returns with a report that says which part is damaged, so the repair crew goes to the right place.

ExpressRoute and other gateways

For ExpressRoute, the main checks live in the circuit, peering, and gateway pages, plus the monitoring tools. Network Watcher helps by showing the effective routes learned from the gateway, running next hop to see if traffic uses the gateway, and running Connection Monitor tests between Azure and on-premises machines. Together, these show whether routes were learned, whether traffic takes the gateway path, and how the delay behaves.

A sensible order for gateway problems

  1. Check the gateway and connection status in the portal.
  2. Run VPN troubleshoot, and read the summary.
  3. Check the effective routes on a machine behind the gateway.
  4. Run next hop for an on-premises address, and confirm it points at the gateway.
  5. Run a Connection Monitor or connection troubleshoot test to a machine on the other side.
  6. Compare the settings on the on-premises device with those in Azure.
i
Keep both configurations side by side

Most tunnel problems come from tiny differences between the two ends, such as a different key lifetime or a mistyped address range. Put the two configurations next to each other and compare them line by line before anything else.

12Flow Logs: Recording Conversations

Diagnostic tools answer a question now. Flow logs keep a record of every conversation, so that you can answer questions about the past as well.

flowchart LR
    A["Packet crosses the network"] --> B["Platform notes the flow details"]
    B --> C["Flow records collected every minute"]
    C --> D["Written to a storage account as JSON files"]
    D --> E["Optional: processed by Traffic Analytics"]
    E --> F["Stored in a Log Analytics workspace"]
    F --> G["Queried, charted, and alerted on"]
    D --> H["Kept or deleted by retention policy"]
    G --> I["Insights lead to rule changes"]
    I --> A
    
Figure 3: The life of a flow record, from a packet on the network to a decision about rules

The diagram traces one flow record through its life. A packet crosses the network, and the platform notes the conversation details. Records are gathered each minute and written to a storage account. If Traffic Analytics is switched on, they are also processed and stored in a Log Analytics workspace, where you can query, chart, and alert on them. What you learn leads to changes in rules, which changes the traffic, and the loop continues. Meanwhile, a retention policy decides how long the raw files are kept.

What a flow log contains

Each record describes a conversation using the five-tuple: source address and port, destination address and port, and protocol. It also says which direction the traffic went, which rule handled it, and whether it was allowed or denied. Newer versions of the log add information about how many packets and bytes were exchanged, and the state of the connection. The records are summaries, not copies of the data itself. They show who talked to whom, but not what they said.

Analogy

A flow log is the visitor register at the building entrance. It lists who came, from which company, which room they visited, at what time, and whether the guard let them in or turned them away. It does not record the conversation inside the room.

What you can learn from flow logs

  • Who is connecting to a sensitive machine, and from where.
  • What is being blocked, which may show attacks or applications trying to reach things they should not.
  • Which rules are never used, so they can be removed.
  • Which ports and protocols are really used, so rules can be tightened to match.
  • How much traffic flows between parts of the network, to guide planning and cost.
  • Evidence for investigations after an incident.

Where flow logs are stored

OptionGood forRemember
Storage account onlyCheap keeping of raw records, for audits and later analysis by other toolsNo built-in charts; you need other tools to read the files
Storage plus Traffic AnalyticsBrowsing charts, maps, and top talkers in AzureCosts more, because data is processed and stored in the workspace
Streaming to other toolsFeeding security products or custom pipelinesNeeds extra setup and outside tools

Retention

Set a retention period for flow logs in storage, based on rules and need. Keeping logs forever costs money. Keeping them too briefly may leave you without evidence when you need it. Some regulations set minimum periods. Agree the number with your security and compliance teams.

!
Turn it on before the incident

Flow logs cannot show you yesterday if they were switched on today. Enable them as part of building the network, not after the first problem.

13NSG Flow Logs and Virtual Network Flow Logs

Flow logs exist in two generations. Knowing the difference matters, because Microsoft has announced a move from the older kind to the newer.

The older kind: NSG flow logs

NSG flow logs record traffic at the level of a network security group. You switch them on for each group, and they record flows that were allowed or denied by that group’s rules. They have been the standard for years and appear in many guides and tools. However, they only see traffic that passes through a group, and they require turning on logging group by group.

The newer kind: virtual network flow logs

Virtual network flow logs record traffic at the level of a virtual network, a subnet, or a network interface, instead of at the group. They aim to be simpler to manage and to cover more cases, including traffic that is not subject to a security group. They record information about whether a flow was allowed or denied under the rules, and about the state of the connection and the volume of data. They can be enabled for a whole network at once, which makes coverage much easier to achieve and prove.

Analogy

NSG flow logs are like a visitor register kept at each office door. Virtual network flow logs are like a register kept at the gate of the whole campus. The campus register is easier to keep complete, because you do not have to remember to put one at every door.

QuestionNSG flow logsVirtual network flow logs
Scope of switching onOne network security group at a timeA virtual network, subnet, or network interface
CoverageOnly traffic seen by that groupWider coverage of traffic in the network
Management effortHigher in large estatesLower, with fewer settings to keep
FutureAnnounced for retirementThe recommended direction
Works with Traffic AnalyticsYesYes

What this means for you

Microsoft has announced that creating new NSG flow logs would stop at a set date and that the older logs would be retired later, with a recommendation to migrate to virtual network flow logs. The exact dates, migration steps, and behavior have been published in Microsoft’s documentation and may be updated. Check them before you plan, and treat any date quoted in an article as a hint rather than a fact.

A migration plan

1

Inventory what you have

List every network security group with flow logs on, where the logs go, and who uses them.

2

Decide the new scope

Choose which virtual networks or subnets will carry the new logs, aiming for broad coverage.

3

Run both for a while

Turn on the new logs while the old remain, then compare the results and adjust any queries and dashboards.

4

Update the consumers

Change reports, alerts, and outside tools that read the old format so that they read the new one.

5

Retire the old logs

Switch off NSG flow logs once the new ones are trusted, and tidy storage and retention settings.

Watch out for differences in data

The records may use different field names, different structure, and different counts of flows. Queries written for one format may not work on the other. Test your dashboards and alerts with the new data before relying on them.

i
Start new work on the new logs

For any new network, enable virtual network flow logs from the start. That way you never need to migrate it later.

14Traffic Analytics

Raw flow logs are files full of lines. Traffic Analytics turns them into maps, charts, and tables that a person can read and act upon.

What it does

Traffic Analytics reads your flow logs, adds extra information such as geography, known malicious addresses, and Azure resource names, and stores the result in a Log Analytics workspace. You then browse dashboards that show how traffic moves through your network, or run queries for your own questions.

What you can see

Who

Top talkers

The machines that send and receive the most traffic.

Where

Geographic map

Where inbound and outbound traffic comes from and goes to in the world.

What

Ports and protocols

Which applications generate traffic, and which open ports are actually used.

Blocked

Denied flows

What your rules are rejecting, which can reveal attacks or mistakes.

Risk

Suspicious traffic

Flows involving addresses known to be malicious, based on Microsoft’s threat information.

Paths

Network and subnet views

Traffic between virtual networks, subnets, and gateways, and how busy each link is.

Analogy

If flow logs are the raw visitor register, Traffic Analytics is the clerk who reads thousands of pages, sorts them, and hands you a one-page summary: “These ten visitors came most often. This visitor from a risky company tried the back door twice. These doors were never used.” You still make the decisions, but you start from a summary.

Processing interval

Traffic Analytics processes logs at a chosen interval. A shorter interval gives fresher charts and costs more, and a longer interval is cheaper but slower to show change. The options and defaults can change, so check the current documentation and pick the interval that matches how fast you need to react.

How to use it well

  • Review denied traffic weekly. Look for patterns, not single events.
  • Check open ports. Rules that allow ports nobody uses are candidates for removal.
  • Watch for unexpected destinations. A database server talking to a country you do not do business with deserves a question.
  • Use it for planning. Traffic between regions and out to the internet guides cost decisions.
  • Create saved queries for the questions you ask again and again.

Cost awareness

Traffic Analytics charges for the volume of flow data it processes, plus the storage of results in the workspace. In a large estate, this can become one of the larger monitoring costs. Limit it to the networks where the insight is worth the price, and shorten workspace retention where long history is not needed.

!
Do not treat a chart as proof

Analytics summarizes flows and enriches them with outside information, which can be incomplete. Use it to find leads, then confirm with the raw logs or a packet capture before taking a serious action such as blocking a partner.

15Alerts, Dashboards, and Integration

Data that nobody looks at does not help. This chapter shows how Network Watcher results reach people, at the right time and in the right shape.

Alerts

Azure Monitor can raise an alert when a measure crosses a limit. Connection Monitor produces metrics such as failed checks and round-trip time, which are natural alert sources. Log Analytics queries over flow data can also trigger alerts, for example when denied connections to a database jump suddenly. Alerts can email people, send messages to chat, create tickets, or start automated responses.

Alert ideaSourceWhy it matters
Checks failing between web and database tiersConnection MonitorThe application is about to fail or already has
Round-trip time above normal on the office linkConnection MonitorUsers will feel slowness
Sudden rise in denied inbound flowsFlow logs queried in Log AnalyticsPossible scanning or attack
Outbound traffic to a new countryTraffic Analytics dataPossible data leak or malware
VPN tunnel disconnectedGateway metricsOffice has lost its link to Azure
Change to a network security groupActivity logRules changed; was it planned?

Dashboards and workbooks

Azure dashboards and workbooks let you gather charts from many sources onto one page. A good network dashboard shows the status of key tests, traffic volumes, denied flows, and gateway health. Show it on a screen in the team room, and review it in your regular meetings.

Integration with other tools

  • Microsoft Sentinel and other security tools can read flow data to detect threats.
  • Event hubs can stream logs to outside systems.
  • Automation can run scripts or workflows when an alert fires, for example to collect a packet capture when a test fails.
  • Ticketing systems can receive alerts and attach diagnostic results.
Analogy

An alarm system is only useful if someone hears it. Alerts are the ringing bell, the dashboard is the control panel on the wall, and the integrations are the phone lines to the people who must respond. All three must work, or the best sensors in the world are wasted.

Avoiding alert fatigue

Too many alerts teach people to ignore all of them. Start with a few meaningful alerts. For each one, write down who responds and what they do. If an alert fires often and nobody acts, change its threshold or remove it. Alerts should point to real problems, not to normal variation.

i
Attach the first step to the alert

Put a link to the right diagnostic tool or a short runbook in the alert message. The person who receives it at night should know the first thing to check without having to think.

16Security, Access, and Privacy

The tools that see everything in your network are themselves worth protecting. Used well, Network Watcher improves security. Used carelessly, it can create new risks.

Who may do what

Give each person only the permissions they need. Reading topology or effective rules is low risk. Running diagnostic tests is moderate. Starting packet captures, reading flow logs, and changing monitors are higher risk, because they can reveal sensitive information about how systems talk to each other. Use custom roles to separate these duties.

Protect the stored data

Storage

Secure storage accounts

Use private access, encryption, and tight permissions for accounts holding flow logs and captures.

Retention

Delete on schedule

Apply lifecycle rules so old files are removed or moved to cheaper tiers automatically.

Access

Limit readers

Only security and network staff should read the logs. Consider read-only access for most.

Integrity

Guard against tampering

Where logs serve as evidence, use immutable storage options so they cannot be altered.

Use the tools to improve security

  • Check rules before and after changes using IP flow verify and NSG diagnostics.
  • Use flow logs to find overly broad rules and replace them with specific ones.
  • Look for traffic between tiers that should not talk, and block it.
  • Check that management ports are not reachable from the internet.
  • Feed flow data to security tools for threat detection.
Analogy

The security camera room contains footage of everyone in the building. It must have a good lock, a short list of people with the key, and rules about who may copy tapes. A camera room that anyone can walk into is a risk, not a protection.

Privacy and compliance

Flow logs record addresses, which can count as personal data in some places. Packet captures may contain even more. Check the rules that apply to your organization and region about collecting, keeping, and sharing this information. Document why you collect it, who can see it, and when it is deleted. Involve your legal and privacy teams early.

Resource locks and governance

Use Azure Policy to require flow logs on new networks, and to stop people from turning them off. Use resource locks on the resource group that holds Network Watcher, so that accidental deletion does not remove your tools. Track changes to monitors and logging settings through the activity log.

!
Logs can leak

A flow log shows exactly which machines talk to which, on which ports. In the wrong hands it is a map for an attacker. Treat monitoring data as sensitive, with the same care as the systems it describes.

17Cost and Optimization

Many of Network Watcher’s tools are free to use, but the tools that keep running and store data carry charges. Knowing where the money goes keeps the bill predictable.

What is usually free

  • Network Watcher itself, as a resource that exists in a region.
  • Topology views, effective security rules, and effective routes.
  • On-demand diagnostic checks such as IP flow verify and next hop, within current service terms.

What usually costs money

ItemHow it is chargedHow to reduce it
Flow logsBy the volume of log data collectedLog only what you need; avoid noisy networks that offer little value
Storage for logs and capturesBy size and time kept, plus accessSet retention; use lifecycle rules to move old data to cheaper tiers
Traffic AnalyticsBy the volume of flow data processed, plus workspace storageUse a longer processing interval; enable only where insight is needed
Connection MonitorBy the number of tests, and the data stored in the workspaceTest only the paths that matter; lower the frequency for stable paths
Log Analytics workspaceBy data ingested and keptShorten retention; filter data; use commitment tiers if volumes are high
Packet captureBy storage used for the capture filesCapture briefly with filters; delete files after the investigation
Alerts and dashboardsSmall per-rule chargesRemove alerts that nobody uses
Analogy

A security camera system costs little to install, but recording every camera in high quality for years needs a huge storage room. The wise owner records the important doors at a sensible quality, keeps footage for a fixed time, and clears out the rest.

Cost levers in order of impact

1

Choose the scope of flow logs wisely

Production and sensitive networks justify full coverage. Short-lived test networks often do not.

2

Set retention to the real requirement

Keep raw logs as long as rules demand, not forever. Keep analytics data in the workspace for a shorter time.

3

Tune Traffic Analytics

Pick the interval that fits your response time, and restrict it to networks where charts are used.

4

Trim Connection Monitor

Remove tests nobody reads and reduce frequency where changes are rare.

5

Review every quarter

Check cost by resource type, find the largest items, and ask whether each still earns its place.

Cost of not monitoring

It is easy to focus on the bill for monitoring and forget the cost of blindness. An hour of downtime for a busy application, or a security incident that cannot be investigated because the logs were never on, can cost far more than a year of monitoring. The goal is balance, not zero spending.

i
Check current prices

Prices, free allowances, and meter names differ by region and change over time. Use the Azure pricing calculator and your own billing reports for real numbers, and treat any figure in an article as a starting point only.

18Hybrid, Multi-Region, and Other Diagnostics

Real networks span regions, offices, and the internet. Network Watcher offers a few more views for these wider questions, and a few habits for using the tools across many networks.

Looking across regions

Because Network Watcher is regional, a company with networks in several regions has several instances to manage. Connection Monitor can test across regions, which shows whether delay between two regions is normal. Keep a naming standard so that tests and logs from different regions are easy to match up, and use one shared workspace or a clear workspace plan so results are not scattered.

Hybrid monitoring

For networks linked to offices through a VPN or ExpressRoute, the interesting question is often, “How is the path between the office and Azure behaving?” Connection Monitor can use on-premises machines as sources or destinations, if they have the monitoring agent. The result is a view of delay and loss across the hybrid link, which helps tell the difference between a problem in Azure, a problem in the link, and a problem in the office.

Internet-facing views

Internet

Reachability and latency reports

Network Watcher has offered views of expected internet latency between regions and internet providers, and reports on reachability. Their availability and form have changed, so check current documentation.

Outside-in

Testing public endpoints

Connection Monitor can probe public websites and services from inside Azure, to confirm your outbound path and measure the delay to key partners.

Capacity

Subscription limits view

Some views list network resource usage against limits, so you can spot a subscription approaching a cap before it blocks a deployment.

Analogy

Watching one building is easy. A company with many offices needs a map of all of them, a standard way of reporting, and a central desk that reads all the reports. Planning for many regions and links is the difference between a handful of cameras and a monitoring system.

Habits for many networks

  • Standardize names for monitors, workspaces, storage accounts, and resource groups.
  • Use code to deploy monitors and flow logs, so every new network gets them automatically.
  • Use policy to require logging on networks, and to report networks that lack it.
  • Choose workspaces by ownership and compliance needs, not by whim.
  • Share runbooks across teams, so everyone uses the same first steps.

Working with other Azure tools

Network Watcher is one part of a bigger picture. Azure Monitor collects metrics and logs from many services. Azure Firewall and Application Gateway keep their own logs. Log Analytics brings them together. Service Health tells you about platform problems that are not your fault. When you troubleshoot, use Network Watcher for the network path, and the others for the devices and services along it.

i
Compare with the platform

If many unrelated resources in one region report trouble at the same time, check Azure Service Health before you blame your own settings.

19Design Patterns and Decisions

Experienced architects write down major choices as short decision notes. Here are common decisions for network monitoring, written in that style so you can see how the reasoning goes.

ADR-01Accepted
Decision

Enable virtual network flow logs on all production virtual networks, writing to a protected storage account with a fixed retention period.

Reason

We need evidence for incidents and audits, and broad coverage is easier to prove at the network level than rule group by rule group.

Cost

Storage and processing charges grow with traffic, and the team must manage retention and access.

ADR-02Accepted
Decision

Use Traffic Analytics only on production and security-sensitive networks, with a sixty-minute processing interval.

Reason

Charts are most valuable where people actually review them, and a longer interval keeps cost down while still catching trends.

Cost

Fresh insight is slower, so urgent investigations must use raw logs or live tools.

ADR-03Accepted
Decision

Run Connection Monitor tests on five critical paths: web to application, application to database, office to application over the private link, application to payment partner, and region to region.

Reason

These paths decide whether the business works. A few well-chosen tests are easier to maintain and respond to than a broad set.

Cost

Other paths are not continuously tested, so problems there are found by users or by on-demand tools.

ADR-04Proposed
Decision

Restrict packet capture to a small group of senior engineers and require a ticket for each use.

Reason

Captures can contain sensitive data, so use must be justified, recorded, and limited in time.

Cost

Urgent troubleshooting may be slowed by the approval step, so an emergency path must be defined.

Patterns that work

Pattern

Diagnose before you change

Use effective rules, next hop, and IP flow verify to understand a problem before editing any setting.

Pattern

Monitoring as code

Define monitors, flow logs, and alerts in templates and deploy them with every new network.

Pattern

Central workspace

Collect results from many networks into planned workspaces for easier queries and alerts.

Pattern

Baseline and compare

Record normal delay and traffic, and compare any complaint against the baseline.

Pattern

Tiered logging

Full logging for production, reduced for development, none for throwaway test networks.

Pattern

Runbooks linked to alerts

Every alert names the first tool to use and the person who responds.

Anti-patterns to avoid

Avoid these

  • Switching on logging only after an incident
  • Keeping logs forever with no retention policy
  • Letting anyone start packet captures
  • Monitoring everything with no one reading the results
  • Changing rules first and diagnosing later
  • Relying on the older flow logs without a migration plan

Do these instead

  • Enable logging as part of building the network
  • Set retention based on rules and need
  • Control captures through roles and tickets
  • Monitor chosen paths with named owners
  • Diagnose with tools, then change one thing
  • Plan the move to virtual network flow logs
Observability is cheapest when it is built in, and most expensive when it is added in a crisis.

20Best Practices and Common Mistakes

This chapter gathers lessons that many teams learn the hard way. You can learn them the easy way, by reading them first.

Best practices

  • Check the region first. Make sure Network Watcher exists in the region of the resource you are diagnosing.
  • Start with the simple tools. Effective rules, effective routes, IP flow verify, and next hop answer most questions in minutes.
  • Test with the full five-tuple. Give accurate source, destination, port, and protocol, or the answer will mislead.
  • Remember the other layers. The machine’s own firewall, the application, and DNS are outside what security rule checks can see.
  • Enable flow logs early, with a retention period agreed with security and compliance teams.
  • Prefer virtual network flow logs for new work, and plan migration from the older logs.
  • Use Connection Monitor on the paths the business depends on, with sensible thresholds.
  • Protect the data. Secure storage, limit who can read logs, and control packet capture.
  • Deploy by code and enforce by policy, so coverage is consistent.
  • Create a baseline of normal behavior soon after launch.
  • Link alerts to runbooks and review them regularly.
  • Review cost every quarter.

Common mistakes

MistakeWhat goes wrongBetter approach
Testing in the wrong regionTool reports that Network Watcher is not foundMatch the region of the resource
Trusting “allowed” as proof the connection worksHours lost rechecking rules while the real cause is a route or the machine firewallFollow up with next hop and connection tests
Testing with wrong port or protocolMisleading resultsConfirm the application’s real port and protocol first
Looking at one security group onlyMissing the rule from the other groupUse effective security rules for the combined view
Enabling logs after the incidentNo evidence of what happenedTurn on logs when the network is built
No retention policyRising storage cost, or logs missing when neededSet retention from rules and need
Capturing without filtersHuge files, hard analysis, wasted storageFilter by address, port, and protocol; set a time limit
Open access to captures and logsSensitive data exposedTight roles, private storage, and deletion schedules
Too many monitors and alertsNoise and ignored alarmsFew meaningful tests, each with an owner
Ignoring the retirement of NSG flow logsSurprise loss of logging laterPlan the migration to virtual network flow logs
Skipping the extension on machinesConnection tests and captures fail to startInstall and verify the extension or agent
Analogy

A good caretaker of a large building keeps a floor plan, checks the lock list before blaming the key, installs cameras before a theft rather than after, locks the camera room, and reads the reports. None of these habits is exciting. Together they make the difference between a quiet building and a noisy one.

!
The most common time-waster

Changing settings before diagnosing. A rule edited in haste may fix one problem and open another, and you will not know which change did what. Diagnose first, change one thing, test again, and record the result.

21Real-World Usage Scenarios

Here are typical ways organizations use Network Watcher. These are common patterns described in general terms, not accounts of any named company.

A typical online retailer on a sale day

A retail company sees checkout slowing down during a big sale. The team opens Connection Monitor and sees that round-trip time between the application tier and the payment partner has doubled since noon. The hop view shows the delay begins at the outbound firewall. Flow logs show a large number of connections from one batch job that started at the same time. The team moves the batch job to the night and the checkout recovers. Because the tests and logs already existed, the diagnosis took twenty minutes instead of a day.

A typical bank auditing its rules

A financial company must prove that databases are reachable only from the application tier. The security team enables virtual network flow logs on production networks and sends them to Traffic Analytics. A monthly review lists every source that connected to the database subnet. Two unexpected sources appear: an old reporting tool and a test machine. Both are removed, and the rules are tightened. The saved logs become part of the audit evidence.

A typical software company debugging a new deployment

A development team deploys a new service, and it cannot reach its database. The engineer runs IP flow verify, which reports that the database subnet’s security group denies the port. A rule was written for the wrong application security group. After correcting it, the engineer runs the check again to confirm. The whole fix, from complaint to confirmation, takes ten minutes.

A typical company with a flaky VPN

A manufacturer with a site-to-site VPN to a factory sees the connection drop every few hours. VPN troubleshoot reports repeated renegotiation failures. A side-by-side comparison of settings shows that the key lifetime on the factory device differs from the one in Azure. After the match is made, the tunnel stays stable, and a Connection Monitor test is added to alert the team if it ever drops again.

A typical health organization investigating a stall

An application that sends large images to an archive stalls partway through some transfers. Rules and routes look right. A short, filtered packet capture shows that large packets are not getting through while small ones do, a sign of a size mismatch somewhere on the path. The network team adjusts the packet size settings on the device and the problem disappears. Packet capture found what higher-level tools could not.

Who uses which tool

Support

First-line engineers

Topology, effective rules, IP flow verify, and next hop for quick answers.

Network

Network engineers

Connection Monitor, VPN troubleshoot, and packet capture for deeper problems.

Security

Security analysts

Flow logs and Traffic Analytics for threats, audits, and rule reviews.

Platform

Platform teams

Policy, templates, and workspaces so that every network is monitored the same way.

Finance

Cost owners

Reports on logging and analytics cost, and decisions on scope and retention.

Leaders

Managers

Dashboards showing health, risk, and trends in plain charts.

Analogy

In a hospital, the nurse takes quick readings, the specialist orders deeper scans, the safety officer reviews records, and the administrator watches the budget. Network Watcher serves all of these roles in a network team, and each person reaches for the tool that suits the job.

22Troubleshooting a Connection: A Playbook

When a connection fails, an ordered approach finds the cause quickly. This playbook uses Network Watcher’s tools in the order that usually works best.

The method

1

Describe the failure exactly

Write down the source, destination, port, protocol, and the time it started. Without these, no tool can help.

2

Check names

If the destination is a name, confirm it resolves to the right address from the source machine.

3

Run IP flow verify in both directions

Check outbound from the source and inbound at the destination. Note the rule named in any denial.

4

Run next hop

Confirm where traffic goes first, and that it matches your design. Also check the return path.

5

Read the effective rules and routes

Look for rules or routes that you forgot or that came from a gateway.

6

Run connection troubleshoot

Send a real test and review the hop list and any issues it names.

7

Look at the logs

Check flow logs for the time of the failure, to see whether the traffic was allowed, denied, or never seen.

8

Capture packets if still unclear

Take a short, filtered capture at one or both ends and read the conversation.

Common symptoms and likely causes

SymptomLikely causeFirst tool
Connection times outSecurity rule drop, missing route, or destination not listeningIP flow verify, then next hop
Connection refused immediatelyDestination reachable but nothing listens on the port, or the machine firewall rejects itConnection troubleshoot, then check on the machine
Works from one machine, not anotherDifferent security groups, routes, or subnetsCompare effective rules and routes of both
Reaches the internet but not on-premisesRoutes from the gateway missing or overriddenEffective routes and next hop
Sometimes slow, sometimes fineCongestion, a busy device, or a path changeConnection Monitor history
Large transfers stall, small ones workPacket size mismatch somewhere on the pathPacket capture
Tunnel up but no trafficMissing routes or overlapping address rangesEffective routes and VPN troubleshoot
Name resolves to the wrong addressDNS settings or private DNS zone link missingName lookup from the source
Unexpected outbound traffic seenCompromised machine or misconfigured applicationFlow logs and Traffic Analytics
Tool says Network Watcher not foundNot enabled in that region, or wrong subscriptionCheck the region and the subscription
Analogy

It is like finding why a parcel did not arrive. Read the label, check the guard’s list, check the route the van took, then follow the van with a camera if still unsure. Going in order saves you from searching the whole city.

i
Write down what you tried

Keep a short note of each test, its result, and the time. If you must hand the case to support, a clear list of what you already checked saves everyone an hour.

23Frequently Asked Questions

Quick answers to questions beginners ask most often.

1Does Network Watcher cost money?
The service itself and its on-demand views are generally free. Charges come from features that store or process data, such as flow logs, Traffic Analytics, Connection Monitor, and packet capture storage. Check current pricing.
2Why do I see a resource group called NetworkWatcherRG?
Azure creates it automatically to hold Network Watcher resources when you first create a virtual network in a region. It is expected and should not be deleted.
3Do I need an agent on my virtual machines?
Not for topology, effective settings, IP flow verify, or next hop. You need the extension for connection troubleshoot and packet capture, and an agent for Connection Monitor sources.
4If IP flow verify says “allowed”, why can I still not connect?
It only checks Azure security rules. The cause could be a route, a firewall appliance, the machine’s own firewall, an application not listening, or DNS.
5What is the difference between connection troubleshoot and Connection Monitor?
Connection troubleshoot is a one-time test for a specific moment. Connection Monitor repeats tests on a schedule, stores the results, and can raise alerts.
6What do flow logs record?
Summaries of conversations: source and destination addresses and ports, protocol, direction, and whether the traffic was allowed or denied. Newer versions add traffic volume. They do not record the content of the data.
7What is the difference between NSG flow logs and virtual network flow logs?
NSG flow logs are tied to individual security groups. Virtual network flow logs work at the level of the network, subnet, or interface and give wider, easier coverage. Microsoft has announced the older kind for retirement, so check current dates.
8What is Traffic Analytics?
A feature that processes flow logs into charts, maps, and tables in a Log Analytics workspace, showing top talkers, denied traffic, and suspicious flows.
9Is packet capture safe to use?
It does not change traffic, but the files can hold sensitive data. Use filters and time limits, restrict who can start captures, store files securely, and delete them when finished.
10How long should I keep flow logs?
As long as your rules and risk need, and no longer. Agree the period with security and compliance teams, and use lifecycle rules in storage to enforce it.
11Can Network Watcher help with VPN problems?
Yes. VPN troubleshoot checks a gateway or connection and reports health and likely causes. Effective routes, next hop, and Connection Monitor help with routing and delay across the tunnel.
12Does it work across regions?
Each region has its own instance, but Connection Monitor can test paths between regions. Enable Network Watcher in every region where you have networks.
13What happened to Network Performance Monitor?
It was an older monitoring tool that Microsoft retired in favor of Connection Monitor. Use Connection Monitor for new work.
14How do I make sure every new network is monitored?
Define flow logs and monitors in templates, deploy them through pipelines, and use Azure Policy to require or report on logging for networks.
15Where should I start learning more?
Read the Network Watcher documentation, then practice on a small test network: create two machines, block a port with a security group, and use IP flow verify and next hop to find the cause. Then enable flow logs and view them.

24Summary and Key Takeaways

Network Watcher turns your Azure network from a black box into something you can see, test, and record. It rewards habits of diagnosing before changing and logging before incidents.

In this guide you met Network Watcher as the control room of your Azure networks. You learned how it is enabled per region, how topology and effective settings show what really applies, and how IP flow verify, NSG diagnostics, next hop, and connection troubleshoot answer questions about a single connection. You saw how Connection Monitor tests over time, how packet capture reveals the details, how VPN troubleshoot examines gateways, and how flow logs and Traffic Analytics record and summarize conversations. You also covered alerts, security, cost, patterns, common mistakes, and a playbook for troubleshooting.

Key Takeaways

  • Diagnose before you change. Effective rules, effective routes, IP flow verify, and next hop answer most questions in minutes and avoid blind edits.
  • “Allowed” is not the same as “working”. Security checks cover only part of the path, so follow up with routes, real connection tests, DNS, and the machine itself.
  • Region matters. Network Watcher is regional, so enable and use it in the region of the resource.
  • Test continuously where it counts. Use Connection Monitor on a few critical paths, with clear thresholds, owners, and alerts.
  • Record before you need to. Turn on flow logs early, prefer virtual network flow logs for new work, and plan the move away from the older logs.
  • Protect what you collect. Flow logs and captures describe your network and your data, so lock down storage, limit access, and delete on schedule.
  • Balance insight and cost. Scope logging and analytics to where they are used, set retention, deploy by code, and review the bill every quarter.