maciejpi/nordabiz
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

fix: expand blacklist, improve bulk progress UX
Some checks are pending
NordaBiz Tests / Unit & Integration Tests (push) Waiting to run
Details
NordaBiz Tests / E2E Tests (Playwright) (push) Blocked by required conditions
Details
NordaBiz Tests / Smoke Tests (Production) (push) Blocked by required conditions
Details
NordaBiz Tests / Send Failure Notification (push) Blocked by required conditions
Details

Browse Source 
- Added norda-biznes.info, bizraport.pl, aplikuj.pl, lexspace.pl,
  drewnianeabc.pl, f-trust.pl, itspace.llc to directory blacklist
- Delay first poll by 3s so thread has time to populate total
- Better completion messages (show count, handle 0 remaining)
- Increase poll interval to 3s

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
Maciej Pienczyn 2026-02-21 08:43:43 +01:00
parent 13cf5ebccf
commit 3340e176aa
2 changed files with 12 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
services/website_discovery_service.py
View File

@ -32,6 +32,8 @@ DIRECTORY_DOMAINS = {
'imsig.pl', 'monitorfirm.pb.pl', 'mojepanstwo.pl', 'biznes-polska.pl',
'zwiazekpracodawcow.pl', 'notariuszepl.top', 'wypr.pl', 'mapcarta.com',
'analizy.pl', 'transfermarkt.pl', 'mojewejherowo.pl', 'orlyjubilerstwa.pl',
'norda-biznes.info', 'bizraport.pl', 'aplikuj.pl', 'lexspace.pl',
'drewnianeabc.pl', 'f-trust.pl', 'itspace.llc',
# Social media
'facebook.com', 'linkedin.com', 'youtube.com', 'instagram.com',
'twitter.com', 'x.com', 'tiktok.com',

14
templates/admin/data_quality_dashboard.html
View File

@ -1211,7 +1211,8 @@
.then(function(r) { return r.json(); })
.then(function(data) {
if (data.job_id) {
pollDiscoveryProgress(data.job_id);
// Wait 3s before first poll to let the thread start
setTimeout(function() { pollDiscoveryProgress(data.job_id); }, 3000);
}
})
.catch(function(err) {
@ -1226,7 +1227,7 @@
fetch('/admin/discover-websites-status?job_id=' + jobId + '&log_offset=' + _discLogOffset)
.then(function(r) { return r.json(); })
.then(function(data) {
var total = data.total || 1;
var total = data.total || 0;
var processed = data.processed || 0;
var pct = total > 0 ? Math.round(processed / total * 100) : 0;
document.getElementById('discProgressBar').style.width = pct + '%';
@ -1242,9 +1243,14 @@
}
if (data.status === 'running') {
setTimeout(function() { pollDiscoveryProgress(jobId); }, 2000);
setTimeout(function() { pollDiscoveryProgress(jobId); }, 3000);
} else {
document.getElementById('discProgressLog').innerHTML += '<div style="color: #22c55e; font-weight: 600;">Zakończono! Odśwież stronę aby zobaczyć wyniki.</div>';
var msg = processed > 0
? 'Zakończono (' + processed + '/' + total + '). Odśwież stronę aby zobaczyć wyniki.'
: (total === 0
? 'Brak nowych firm do wyszukania (wszystkie mają już kandydatów).'
: 'Zakończono. Odśwież stronę aby zobaczyć wyniki.');
document.getElementById('discProgressLog').innerHTML += '<div style="color: #22c55e; font-weight: 600;">' + msg + '</div>';
document.getElementById('discCloseBtn').style.display = 'inline-block';
}
});