The winning TD came on a five-yard pass from Del Rio to a wide open Freddie Swain with 43 seconds remaining.
"As you can imagine, very heartbreaking loss for us and our team", Stoops said afterward.
Kentucky had a chance late in the second to make it 17-14 but Austin MacGinnis' 48-yard attempt hit the upright for a miss.
For almost 60 minutes Saturday night, it looked as if the streak was going to end.
However, Kentucky's defense twice left receivers uncovered and Florida turned both into scores. "Just can't tell you how much I really like our football team, our guys". Last week, Feleipe Franks threw a 63-yard touchdown pass to Tyrie Cleveland on the game's final play to beat Tennessee 26-20.
Del Rio, who appeared very poised for someone who had not played in a game since last November 5, and the offense seemed to gel when they needed to most, in the decisive fourth quarter.
Florida's streak over the Wildcats is the longest active in the nation and fourth-longest all time.
UK's go-ahead drive came two possessions after Toney took a snap from center and dashed through the Kentucky defense for a 36-yard touchdown.
The Cats led by 13 points with 11:33 remaining in the game, and United Kingdom fans thought this could be the night that Kentucky makes history. "We had a lot of guys make plays after broken tackles". However, a holding penalty on Nick Haynes negated it forcing MacGinnis to attempt a 57-yard field goal as time expired.
After the Wildcats limited their first three opponents to a combined 171 yards, Florida rumbled for 186 yards. But on his first series, he made Darius West look like Ronnie Lott as he delivered an interception that could (should) have begun to bury that streak for good. Lynn Bowden also completed a 24-yard pass for Kentucky.
Johnson hit tight C.J. Conrad for a 23-yard touchdown strike on the Wildcats' first possesion of the third period and after a second straight three-and-out by the UF offense, United Kingdom drove 41 yards for a 42-yard McGinnis field goal and two-possession advantage. It was the second touchdown pass of the night from a Florida quarterback to an undefended receiver, the first coming before halftime on a 45-yard strike from Feleipe Franks to Tyrie Cleveland. Sewo Olonilua punched in a 1-yard plunge - which he later fumbled, but the call of touchdown was upheld upon review - to give the Frogs a 34-17 lead.
In the decisive fourth quarter, the Gators rode true freshman running back Malik Davis, who finished the game with 93 yards on 21 carries. Washington caught six passes for 153 yards and a score, and Justice Hill carried 25 times for 102 yards and a score.
Florida: The Gators played catch-up all night and their perseverance once again paid off in the end thanks to Del Rio, who was the QB in last year's 45-7 rout of Kentucky in Gainesville. "I knew we could move the ball better".
Stoops said the Wildcats will regroup in prepare for a non-conference encounter against Eastern Michigan Saturday and can build on the team's achievements during the first four encounters.