Taylor Hall, Kyle Palmieri and Travis Zajac scored for the Devils (6-6-1), who haven’t won consecutive games since starting the season with four straight wins.
Cory Schneider started in goal for the Devils but was replaced by Keith Kinkaid in the second period after allowing four goals on 22 shots. Kinkaid turned aside 17 shots in relief.
Dzingel gave the Senators a 6-2 lead at 10:11 of the third before Zajac made it 6-3 at 14:13. Paarjarvi got his first point of the season with an empty-net goal at 18:01. Ottawa had been outscored 21-12 in third periods prior to Tuesday.
Hall got the game’s first goal as he used a toe drag to bring the puck into the slot and fire a shot past the glove hand of Anderson just 3:14 into the game.
That lead was doubled at 11:20 when Palmieri deposited a backhand off a rebound past Anderson, but for the next 48 minutes it was all Senators.
Chabot scored on a point shot at 12:05 and then Stone tied the game 2-2 just 53 seconds later on a beautiful backhand pass from Duchene across the crease.
The Senators scored three times in the second period and it started just 2:27 in when White had a tap in after a terrific cross-crease pass from Stone.
Stone scored his second of the game and at the same time chased Schneider from the New Jersey net at 7:35. Schneider was replaced by Kinkaid, who surrendered a power-play goal to White on the third shot he faced with less than three minutes to play in the period.