fix(scout): repair Roche/Apple, add Amazon+Axpo, make title filtering fail-open
Scraper fixes: - Roche: new fetch_phenom adapter (Phenom refineSearch). The old playwright scrape of ?locationsearch=Switzerland harvested recommendation-widget cards (Shanghai, Kyiv, Bogota) while the page reported no-results. 0 -> 88 CH-eligible roles. - Apple: dropped default_location "Switzerland", which relabelled US "Various Locations" postings as Swiss (84 phantom CH rows over 4 runs). Now honestly 0. - Meta: NOT broken — metacareers reports "1 Items" for Zurich. Comment added so it is not "fixed" again. New boards: - Amazon/AWS (fetch_amazon): 32 CH roles incl. a Zurich AWS FDE req and a Bern ProServe Cloud Architect. AWS is the evidenced cloud; claims.json forbids GCP. - Axpo (teamtailor via base_url + pagination): 461 roles, opens the energy lane. Locations read from schema.org jobLocation with ISO alpha-2 expanded, so Madrid/Milan/Warsaw roles are not marked Swiss. Telenor benefits too. Title filtering now has two explicit modes. Inclusion allowlists fail closed and hide unanticipated good-fit roles, so they are now used only where volume forces it (>~200 roles). Everything else uses the shared, board-agnostic NOISE_TITLE_EXCLUDE, which fails open and leaves the final call to the scorer and the reviewer. Palantir stays unfiltered per its existing documented rationale. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,20 @@
|
||||
import io
|
||||
from playwright.sync_api import sync_playwright
|
||||
out = io.open('_ap_out.txt', 'w', encoding='utf-8')
|
||||
with sync_playwright() as p:
|
||||
b = p.chromium.launch()
|
||||
pg = b.new_page()
|
||||
calls = []
|
||||
pg.on('response', lambda r: calls.append((r.request.method, r.url, r.status,
|
||||
r.headers.get('content-type', ''), r.request.post_data)))
|
||||
pg.goto('https://jobs.apple.com/en-us/search?location=switzerland-CHE',
|
||||
wait_until='domcontentloaded', timeout=60000)
|
||||
pg.wait_for_timeout(10000)
|
||||
for m, u, st, ct, pd in calls:
|
||||
if 'jobs.apple.com' in u and ('api' in u or 'search' in u or 'graphql' in u):
|
||||
out.write('%s %s [%s] %s\n' % (m, u[:170], st, ct[:40]))
|
||||
if pd: out.write(' POST %s\n' % pd[:400])
|
||||
out.write('---- page text ----\n')
|
||||
out.write(pg.inner_text('body')[:1200])
|
||||
b.close()
|
||||
out.close()
|
||||
Reference in New Issue
Block a user