Jermain Defoe admits the way Sunderland threw away their advantage and allowed Crystal Palace back into the game is not good enough.
Defoe was the standout performer for the Black Cats, scoring twice to put them 2-0 up on the hour mark.
But within 30 seconds of his second clinical strike hitting the back of the net, Palace had halved the deficit through Joe Ledley's deflected effort.
It left the 33-year-old scratching his head, with Sunderland still looking for their first win of the season.
Defoe believes there were many positives to take out of the game but said the team should have seen the game out after taking a two-nil lead with half an hour to go.
"When you have a good performance and come away with no points it is a difficult one to take," reflected Defoe.
"We are improving but when you concede 30 seconds after you score a second, it is not good enough. All the players know.
"You have to win the game when you are 2-0 up, especially when you need the points.
"It is hard to take because it is not like we were outplayed or they were the better team. Second half we created a lot of chances.
"Even if we had drawn, I would have been disappointed.
"When you score you celebrate but you have to then concentrate and switch on straight away.
"It is a funny one because there were a lot of positives we can take from the game.
"We created chances, the energy levels were better, we passed when we needed to and there were more crosses into the box, which is what the manager wanted.
"We got the two goals and you think you are going to win the game.
"I thought we were going to score again when we went 2-0 up," he told the club website.
Sunderland now prop up the rest of the Premier League table, with the club still without a league win in August and September since 2012.
Defoe knows David Moyes' side cannot afford another slow start to the season.
"It is not often you score twice and come away disappointed," he added.
"It is still early days, only six games, but we don't want to wait until the last couple of months.
"We want the points now to show people how good we are as a team.
"We have to keep our heads up and keep working hard."
Next up for Sunderland is the visit of West Bromwich Albion to the Stadium of Light on Saturday afternoon.
And top scorer Defoe, who now has four goals to his name this season, says all Sunderland can do is get back on the training ground and work hard.
He added: "It is important we take something against West Brom, we need to forget about this one.
"Get back on the training pitch and work hard and try and put in the same performance, hopefully you get a little bit of luck and start to get the points that you need.
"They are probably thinking how did we come away with three points? Hopefully that will be us next week."