NEW YORK — On the eve of Roger Clemens' return, the Yankees pulled out a victory reminiscent of their powerhouse days during the Rocket's first tour in pinstripes.

Andy Pettitte and Mariano Rivera supplied the pitching, Derek Jeter hit a game-winning infield single in the 10th inning and New York overcame a huge defensive mistake to rally past the Pittsburgh Pirates 5-4 Friday night and extend a winning streak to four for the first time this season.

It seemed a lot like 1999.

"We didn't plan it like that, but it just happened," Rivera said.

Chris Duffy put Pittsburgh ahead 4-2 in the seventh with a two-run, inside-the-park homer that sailed over center fielder Melky Cabrera and bounced to the wall, but New York tied the score in the bottom half when Jeter chased Tom Gorzelanny with an RBI single and Jorge Posada hit a run-scoring single off Salomon Torres.

A night after getting five outs in Chicago to save Joe Torre's 2,000th win as a manager, Rivera (2-3) pitched two innings for the first time since last Aug. 27, lowering his ERA to 4.13 with his eighth straight scoreless outing.

"These are the types of games that we've, in the past, have had a habit of winning," Torre said.

And on Saturday, Clemens makes his first start for the Yankees since 2003.

"We're excited, obviously," Pettitte said. "It's a good time for him to be coming back. We feel a lot better about ourselves."

Pittsburgh, swept in a three-game interleague series at New York two years ago, remained winless at Yankee Stadium since the 1960 World Series.

"We played a great ballgame and we did everything we could do," manager Jim Tracy said after his team lost for the seventh time in 10 games. "The unfortunate thing is that, obviously, offensively we had some good opportunities we couldn't cash in."

Robinson Cano started New York's winning rally with a double to left-center leading off the 10th against Matt Capps (3-3), and Cabrera sacrificed him to third. Miguel Cairo followed with a bouncer to third baseman Jose Bautista, who looked back at Cano, then didn't throw to first as Cairo reached on the single.

Cairo went to second on defensive indifference, Johnny Damon was intentionally walked and Jeter swung at a two-seam fastball that ran in on him and hit a slow bouncer that second baseman Freddy Sanchez couldn't come up with.

"I was lucky, pretty much. That's all you can say. It's not like you try to hit it right there," Jeter said. "I didn't have a good swing. It wasn't a good pitch to hit. It basically went where no one was standing."

Xavier Nady's second-inning homer and Jack Wilson's RBI single in the fifth built a 2-0 lead for Pittsburgh that was erased by Hideki Matsui's two-run, sixth-inning homer off Gorzelanny.

Duffy, Pittsburgh's No. 9 hitter, hit what appeared to be an inning-ending liner with one on in the seventh. Cabrera took a step in, then froze. Duffy scored without a throw to complete the two-run homer, sliding even when he didn't have to.

Duffy was in awe of Yankee Stadium.

"This place is pretty special. It's pretty neat," he said.