And the big striker feels that United need to "give it a right go" against last season's champions, rather than letting Pep Guardiola's side dictate the game at the Etihad Stadium.
Head coach Steve Bruce has admitted that the Magpies were "too passive" in the first half of the cup clash, but Newcastle were stronger in the second period and Carroll has called for more of the same this time around.
"I think second half we played a lot better when we went attacking them," said Carroll, who started the cup tie and will hope to shrug off a groin strain in time to feature again on Wednesday.
"I think we sat too deep too early and let them dominate the game, and they brought it to us instead of us to them. I think we need to go out and play, especially at their place - I think we have to give it a right go.
"You give them enough time on the ball and they're just going to keep 90 per cent of it. They're a tough team to play against."
United have shown in recent weeks that they have plenty of attacking prowess, too, and have scored ten goals in four league games since returning to action last month.
They've picked up eight points from those matches, although Carroll feels it could and perhaps should have been even more, with the Magpies held to draws at home to Aston Villa and, on Sunday, his old club West Ham.
"We've lost points with the two draws and we feel like we could have taken all three on both occasions," he said. "But we're safe now, so it's just (about) how high we can go.
"We are professional players, we all go out there to win games. As a professional that's just what you do. I don't think it's 'we're safe now,' we down tools or stop training as hard and things like that. We all are professionals, we know our job - and it's not finished until the end of the season."
And Carroll - who signed a new one-year contract with his boyhood club last month - added: "I think obviously Newcastle deserves to be in the Premier League, and in the top ten.
"I think we should definitely be up there and that's what we're pushing for this season."
