A bit more on the topic of “web archives and news media”:

The Tehran Times website has been up for only a few minutes a day in recent weeks (I don’t know if this is related to the military action or to new Western sanctions against Arvan Cloud—since, at least, the edge nodes aren’t in Iran), so web archives are essentially the only place where you can read it 24/7. There’s also a Telegram channel, but it lacks longreads.
New media outlets (the substack generation) are reluctant to link to old media because they can’t add referral IDs and earn a percentage of sales, like in e-commerce and adult industries. Archives, of course, don’t pay either, but some authors prefer linking archives anyway, just to spite greedy tabloids, much like it was on Gamergate. There’s probably a niche here for something like Readly—a site that republishes other’s articles behind its own paywall and pays revshare.

3 个月前

Does this website track you? (I found a: top-fwz1 domain in the source code of archive is)

匿名

Sure, everything is collected by KGB

Are you DMCA compliant?

匿名

I wouldn’t say either “yes” or “no” here. That is, ‘yes’ in the sense that we do remove (or blackrectangle) some pages based on user reports, but “no” in the sense that we would not be eligible for safe harbor if we strictly followed the DMCA (i.e., remove everything, without a fee, but based on non-anonymous reports that must include the verifiable name/address/phone number of the reporter). DMCA safe harbor only works for ISPs and certain websites (those that have appointed an agent and registered them with the U.S. Copyright Office); for everyone else, it is still not “compliance” but “voluntary behavior resembling compliance”

In a strictly legal sense: “no”, because there is no USCO-registered agent.

How do I get illegal revenge porn images removed?

匿名

I think it’s better to go through the police or authorities (NCMEC, WHRIK, etc.). This issue is a really complex, overlapped with OnlyFans piracy, and there are far more parties involved: there are scammers offering to remove content from their own sites for a fee, scammers offering to remove content from other sites for a fee, victims who paid them for nothing, leaks of photo verifications from escort and swinger sites, etc. Everyone has their own made-up story, so we won’t judge who is legal and who is illegal, especially based only on who complained first or who said word “illegal” first. Write a report to the police or the authorities, they will assess your situation and forward it to us if removal is necessary: if you are eager to resolve this without involving the police, we get the impression that you are more likely to be one of those scammers (or OnlyFans revenue-optimizers) than a victim.

Hello, hope everything is going well :) 2 small questions: Any specific reason as to why the archive was down earlier due to a server error? Also, every so often I (and some friends) will see nothing but a rotating loading circle when trying to access the website, what’s the reason for that? Thank you!

匿名

just tech issues

After a lot of reading, I'm inclined to believe that the accusations against you are fabricated, but there's one thing I'm still not clear on: did you actually set up any code to send repeated random requests to an external site?

If so, I'm curious what your reasoning was, as I can't seem to think of a good reason. Even if was a significant threat, that still seems like an odd way to respond.

P.S. If you get the TV interview, could you link to a recording, pretty please? (Even if there's no English)

匿名

It was Patokallio’s blackmail from the beginning: if the 3Hz “DDoS” would stop, he wouldn’t hype the story via his friends in the media, even though hyping it was actually preferable for us than slowly sliding into inferno. We had to continue with the “DDoS” to keep annoying him, so he, thinking he was repaying us with harm, actually carried out a scenario that is a win-win-win for everyone: Jani got his advertising clicks which help him survive in overpriced Australia; Wikipedia got its pill from moral panic; we got vaccinated against the next WAAD (probably against Conde Nast too: after their covering the Wikipedia story, it would be a bit difficult to attack us as “yet another 12ft clone” without accusing Wikipedia in large-scale piracy).

The “changed page” with an Easter egg was supposed only to Patokallio’s eyes: it is the dead link linked from his blog, absent in archive.org (along with whole `lj.rossia.org`—why? someone’s petty revenge for Verbitsky’s “Anti-Copyright” book?), so he must rely on the archived copy to attack the very same archive. The dramatic reaction from Wikipedians, when Jani revealed it to them, was somewhat unexpected, but it did not change anything: they closed the referendum a few days earlier, the result would have been the same. They could have opened and won such a referendum without all this drama—just Patokallio old blog post’s propaganda, which is considered an “authoritative source” there, would have been enough.

This also reinforced the initial guess that it was Patokallio who was behind the media amplification of the “FBI story”: the very same Jon Brodkin of ArsTechnica—who seeded the “FBI story"—acted again as a Patokallio’s sockpuppet: he republished Patokallio’s blog posts instantly, while never wrote anything about us without Patokallio (e.g. on more newsworthy AdGuard/WAAD drama).

The drama has reached the point where it seems we have found a way to accept tax-deductible donations in the US, and German TV is asking for a 15-minute interview.

And someone says: “admit that it turned out badly,” ha ha.

By the way, to save everyone from the usual round of naïve questions (“do you store IP addresses?”, …), to dispel a few comforting illusions about what Terms of Service actually mean, and to give you a glimpse into what it feels like to run, moderate content, and support a website, we highly recommend Kevin Nguyen’s novel New Waves.

It’s a sad, sharp, and often very funny story about a website that differs from ours in only one key respect: it promised not to preserve content, but to delete it on a schedule. As you might guess, that promise becomes the most fragile and consequential part of the whole enterprise. The book captures something that anyone who has worked behind the scenes of an internet platform will immediately recognize: the gap between what users imagine, what policies declare, and what operational reality demands.

We doubt Kevin was OSINTing us—or even knew we existed—when he wrote it. And yet the parallels are striking. In fact, there are more accidental coincidences there than in some stories written by people who explicitly tried to study us.

If you want to understand not just how platforms present themselves, but how they actually function under pressure—read or listen it. It won’t answer every question, but it might help you ask better ones.

In a response you said: "I would understand your claim if you wrote that you unsubscribed from recurring donations. But why should I—or anyone else—be interested in your use of a free utility?" Maybe you shouldn't be interested, except that my concerns seem to be shared by lots of other people — and by Wikipedia, which says you are no longer trustworthy. Maybe you don't care about that either, but if you don't care what users or Wikipedia or any of its users think then why did you bother setting up archive.today in the first place?

匿名

Wikipedia is more than just a lesbian SJW politbüro trying to hide behind a hypernym. Wikignomes (actual content writers) love us for neat features like accordion unfolding or joining multi-page content into a single page, while WMF tries to distance itself from copyright issues and always remained silent. All of this has low priority for many reasons; for example, it seems that this is the only site that actively uses the archive whose bosses have never reached out to us to ask anything or negotiate anything (the only contact is GreenC who is not even allowed to run their WaybackMedic on WMF servers). So it’s mutual.

Why bother setting up: to watch over some pages changing over time. The mistake was to release a free service to the public, it must be paid (or by-invite) from the beginning. There are way too many free users.

4 个月前

anyway, what's your relations to verified.lu?

匿名

The same as to the Olympic ice skater: Patokallio’s cherry-picking.

Better ask Patokallio why he wrote on verified.lu and ignored the ice skater, and how that logic got propagated to become an authoritative source? And how should we treat those who spread this (including Wikipedia), realizing that it is either satire or provocation? With flattery, perhaps?

4 个月前

The archive does host a lot of CSAM though - not to impugn the work of the archive, but whenever somebody seems to report CSAM to the archive, pages are merely hidden rather than fully removed (eg with a vpn). A user complained on x a while ago about the archive not removing CSAM when reported and some archived pages (like smutty.***) contain potentially hundreds of CSAM. Have you at least considered looking yourself and removing any CSAM you see?

匿名

CSAM in user (not, for example, NCMEC’s) reports is often not actually CSAM, but merely a magic word they expect will prioritize their messages. It is not uncommon for users to claim copyright on their “CSAM.”

Many Smutty’s pages reported by authorities have been removed, so I assume they have reviewed everything. Total removal of whole Smutty is sort of an OSINT case, not a CSAM one.

4 个月前

"Trustworthiness" in my question meant "reputation of being trustworthy", i.e. reputation of you not modifying saved pages to insert fake information into them. Guarantees about your archive being trustworthy are literally on the main page:
> Archive.today is a time capsule for web pages! It takes a 'snapshot' of a webpage that will always be online even if the original page disappears
> …
> and provides a short and reliable link to an unalterable record of any web page.
This was true until very recently you chose to tarnish that reputation and began inserting fake information into saved pages.
Do you think there's absolutely no illegal content on your archive, including CSAM? That's simply consequences of you refusing to remove information no matter what. I'm not saying that this approach is wrong or right, you just need to accept these consequences when someone points them out.
Is me saying that some website/company is American also "nationalism" or whatever bad political position you think it is? Or you constantly mentioning that Jani is a finn? This really reeks of "everyone I don't like is Hitler". Don't be ridiculous.

匿名

First, it was not a page you saved; it was a page me saved, moreover from a social network’s webpage me controlled - so I could as well alter the original. That “reputation” is at least no worse than Reddit’s. Second, we do delete/alter pages (see the question about whistleblowers), although we try to minimize that impact. If you need stronger consistency guarantees, you should develop something on a blockchain: Arweave has done something like that. However, it would hardly be compatible with maintaining a clearnet website.
Of course there is some CSAM, as on any user-generated content website. On Twitter, for example, or on Quora. I know this because many CSAM pages reported to us (and deleted) originate from those platforms, not from chans or .onion websites. And those are not ephemeral pages quickly uploaded and screenshotted — they have been there for years; some of them are still there.
Tone of our texts about Jani is a parody of his texts about us: what it might look like if Jani wrote about Jani, we call him “finne” as often as he calls us “guerrilla russian jew”. And we see him (and you?) being unhappy reading that and attempting to take it down, by sending same requests to the same people at Automattic.

It is not about “political positions” at all (who cares on that shit?), it is about preparing the media landscape before sending bogus legally-looking PDFs to the critical infrastructure, just as well as my texts and the whole drama—thanks to “DDoS” promoted to media by himself—might create him problems on border crossing or when approving a loan at a bank. That’s the idea—why threaten to start involved in a scandal under your real name when you know nothing about your opponent, and in your “investigation” you cherry-pick Russian and Jewish names among others solely to include the words “russian” and “jewish” into the text (and then into friendly media, wiki article, etc)? Or to write that “the service does NOT accept crypto” just to slip “crypto” into the text, at least that way? I used to perceive Jani’s texts as merely satirical until serious media started treating them as an authoritative source; then it stopped being funny.

I wanted to say I still support you on liberapay, but now I see I stopped paying about a year ago when my card somehow stopped working. Oops. Maybe you should set a paywall, lol. (No, I love that you don't.) Your site is great even with all the recent drama. You and that girl that does Sci-Hub are two heroes of the internet that everyone somehow also pretends to hate. Of course in the ideal platonic world your site would not be necessary, but here we are.

匿名

thanks!

Well, then let me chim in: I cancelled my weekly Liberapay donations to you in January after all of the DDoS nonsense. Why should I continue to donate to you after you've just destroyed all trustworthiness you had?

匿名

I guess I have already addressed this in my previous messages.

The so-called “trustworthiness” never existed outside either that stock photo scam or in connection with the term “destroyed.” References to “trustworthiness” in public discussions of the archive could only arise when it was explicitly questioned. Previously—thanks to Jani Patokallio—only terms like “guerrilla” and “jews” and “FBI wanted” were used, leaving no space for a “trustworthiness” axis: the questions were floating not around whether it is “a trustworthness site or not”, but whether it is “a criminal pedo site or not”. Do you understand the difference between when say 2% are ready to believe the first thing and when 2% are ready to believe the second thing? The former can cause merely fluctuation in donations, the latter - deplatforming (and not only in tech infrastructure, think Durov story).
While the snapshots were indeed used in civil courts, this was only possible with my written statement—not merely based on some random page online. And yes, in such stories, you are dependent on my whim—whether I choose to assist you or not, as I am under no obligation to do so.
Do not reduce Patokallio’s activities to merely OSINT or doxxing. Publishing open or private information is not an issue at all—there is nothing inherently wrong with “information” part itself. The problem lies in the high density of buzzwords intended to provoke squeamish disdain among certain groups of readers—with quite high a coverage given the variety of those buzzwords—and in the dissemination of that propaganda in the media (and, yes, in the Wiki article, I initially missed that). It is not about publishing random names; it is about commenting on the ethnicity of each name (even that alone shifts the genre of his blog from “investigative journalism” to something else), about cherry-picking words. It is the same kind of preparation as WAAD registering the domain krimo-avocate.fr or his French child porn association. A serious existential threat to us, not comparable to the risk of losing a $2/week donor.

I have used and like archive.today, but the knowledge that when I use it, my browser is hijacked to DDoS some guys website — or that archive.today has been altering screenshots of pages — makes me question whether I can trust your service any more. Why should I continue to use it?

匿名

Well, I would understand your claim if you wrote that you unsubscribed from recurring donations. But why should I—or anyone else—be interested in your use of a free utility? The less you use it, the better it works for the rest, the more time I have for developing new features. It’s already answered as the first question in a new work-in-progress FAQ

I want to take a moment to share another story. This is the second time the archive has been called an “internet notary,” and the previous case also led to retrospective changes.

There’s a fairly widespread scam going around (and it may still be active): stock photo agencies send claims to small website owners, demanding, for example, $9,000 for alleged copyright infringement. If the victim contacts a lawyer, the lawyer often jumps at the opportunity to increase both GDP and overall happiness index, saying something like: “Give me $1,500, and I’ll negotiate with the agency to settle for $3,000”.

These scammers have started using the archive as an “internet notary,” adding statements like: “Even if you delete our protected image, we have notarized proof in the archive,” effectively turning us into their unwitting accomplice.

Right now, this should be the group most disappointed. Aren’t you one of them?

I get your perspective is different and its true that the site has been unfairly maligned for a long time. I guess my perspective is different because I've been using the site for over a decade, and I have deeply appreciated what you are doing, I've donated in the past. Your site is a valuable resource precisely because it often contradicts the narrative of those 'noble' sites. It may feel like a thankless effort, it likely is but its relevance shows its not a lost cause. Thanks for those years.

匿名

Thanks for warm words

in /post/111781148156/are-some-ips-blocked-to-reache-your-site you mention the block

匿名

Oh, 11 years ago… it is probably not actual anymore

out of curiosity what was the reason for blocking small netblock in Poland ?

匿名

Which one? the blocks are mostly AS-based, not country.

In general, many media company offices are blocked; not only because of this drama, we have dramas almost daily (they just lack their own finn to broadcast): in Poland, Wyborcza employees actively bypassed paywalls on competing news outlets and at the same time wrote complaints to Google on 3rd party browser extensions related to archive (the same asserting nobility through a scapegoat).

4 个月前

The entire reason your site was valuable is because of its credibility as a third party archival site. There's a reason the U.S. govt wants to find anything they can to discredit you; because it threatens them to have an objective resource that you can reliably point as proof something was on the Internet or was changed. With this DDoS shit and editing pages you have completely destroyed the site's credibility, & for what? bafflingly self-induced sabotage. Now you've given an excuse not to care.

匿名

Well, look at the attitude of the articles and discussions before the “DDoS” (or even FBI) story. Was it significantly better? The bias was there already.

Myself, I am not happy with this pivot toward being a pirate site where noble websites offload their shit to notorious, making them even more noble and us more notorious.

The drama just incised an existing abscess that would have burst eventually anyway, while you suggest petting and powdering it.

For us it is definitively better, for nobles — not so. Don’t you consider their actions as “self-induced sabotage”?

Yet another improvement: in the absence of tabloid dramas (yet presence finne troll blogs), it was easy for attackers like WAAD to depict us as a “child porn” website: they just put into their report much more various (dis)info overwhelming our media presence. A “website banned on Wikipedia” must be not a “child porn” one at least, while the finne troll’s initial discourse and its dissemination by tabloids was open—not to say crafted—for such interpretations, heavily contributing to increasing trust in letters from WAAD, June Maxam and other trolls (the conflict with the finne troll lies in this, not in his disclose of anything sensitive; that has now been corrected by finne himself, and even better than if he had simply deleted his post). It’s not about number of people read the blog. It’s about what someone who’s never heard of us would see first after getting a WAAD-letter. For example, if they check Wikipedia’s article, or whatever AI tools show them first. If the quotes come from the finne blog, she’ll likely believe the letter, there are also Russian Carders, German Jews, FBI and so on, right? If “this site was used on Wikipedia for years and then got banned for some rant” she likely won’t. The default reputation baseline—thanks to Jani Patokallio’s compilations—was around a “russian” “jew” “shady” “underground” “guerrilla” “carder” “child porn” “FBI wanted” website, not “a wholetrusted internet notary”, as you try to depict.

If you think this is all paranoia and conspiracy theories, consider the fact that WAAD registered a French association whose sole activity, after a year spent in the cold, was to launch a barrage of complaints against us. Trolls are patient operatives, they do play the long games.

Also stop fucking coping about how this was actually "worth it" and a good thing. Take some responsibility for the position and importance you had, and how utterly useless your entire handling of this has been even in pursuit of whatever retributive goal you had in mind. Have you ever heard of the Streisand effect? You do realize that by tying the downfall of the site to that guy's blogpost, now people will have to talk about it as context for what you did? Just own it and admit the mistake.

匿名

That’s basically “keep calm and serve a freeloading ingrate”.

On growth limits, finances, and why OSINTers focus on seemingly random, yet interconnected people:

The “startup” logic seems straightforward: if you have users, buy more servers, grow, invest. Add a paywall or a donation button with sad eyes to cover costs.

So, what’s stopping you?

The lack of reliable financial infrastructure.

This isn’t about post-2022 Russian sanctions or allegations of facilitating illicit activity via PayPal. It’s about the impossibility of reliably exchanging or transferring significant sums within a predictable timeframe without falling victim to a scam (on lower-level services) or triggering an AML check (which often feels like a scam in itself). If there is a delay, the service dies. If you accumulate too many donations on PayPal, you get flagged, and your account is frozen for six months. If you transfer funds to or from a crypto exchange, your bank account may be locked, forcing you to travel thousands of kilometers to resolve it (it was fun during COVID, trying to navigate vaccine mandates). Going 100% Monero (or even Bitcoin) is impossible: donation volumes are significantly lower in crypto, and there are many expenses in fiat. All kinds of intermediaries and small underground fintech companies come to the rescue, but there is a limit to relying on them: how much can you really trust them? Over time, it only gets worse: exchange fees and the risk of losing the entire transaction amount keep growing.

The names and pseudonyms that catch the attention of OSINTers (and probably the FBI, given their interest in “who paid and where”) are not fully random. They often belong to these fintechs: the names used on their credit cards, for example. These are the names of both managers and “drops”, sometimes used unwittingly. Among them are those who worked honestly but are now resentful that OSINTers exposed their names in the context of archives and “piracy,” effectively preventing them from creating new ventures. Then there are those who ran away with the money (including some of ours) and are now actually on the run from police and creditors, obsessively scrubbing their data from the web.

Managing the finances of even a small project like ours would require a full-time specialist. Hiring one, in turn, requires a reliable monthly income. Just one fuck-up by this person could kill the project. And while bracing for that fuck-up, we would have to aggressively solicit donations just to pay their salary.

Since we are a service for latecomers, we have to debunk a couple of myths for latecomers (the list will be updated, and the answers will be supplemented and rewritten, then I will add the results to the FAQ).

We need as many users as possible, and they have some value — no, we don’t need them; there are almost always more users than we can serve. The captcha that annoys you — it’s mainly not against bots.
Paywalls as a selling point — not really.

First, here we’re talking about the West, and that’s far from 100%, and probably not even 50% of users. There’s a lot of Japan and Korea, and there are no paywalls there at all.

Second, some support for news sites only appeared during COVID, because of COVID itself and the demise of projects that actively used the archive (jeuxvideo, taringa, etc.).

Before that, practically all news was archived in an unreadable form, with all the modal pop-ups saying “subscribe to our mailing list” and so on.

When asked to fix it, we replied, “Well, your sites are crap, so we accurately archive them as we see them, and anyway, there’s nothing interesting there. Make normal sites first.”

So, we started cleaning up with COVID, and as it ended, all sorts of moral dilemmas arose, and these are far from just formal issues of legality, copyright, and jurisdiction.

There are also more serious questions, such as whether it is ethical for us to participate in the dissemination of news in the absence of something like COVID?

You may argue that there is a war going on right now (and point to any war), but this is rather a negative example: if the free dissemination of news during COVID can be interpreted as a blessing, many publishers removed their paywalls back then, but it is impossible to explain participation in the dissemination of military propaganda in the same way.

In short, supporting news sites is like carrying a suitcase without a handle: you should drop it, but in the absence of other big categories of users (jeuxvideo, etc.), this would be tantamount to refusing to support Western users (which may not be a bad thing, see question #1).

So it’s not so much a selling point as a current point of rendezvous with users from certain locations.

It turned out pretty well.

The hype around “the site that’s been banned from Wikipedia for the fifth time” is better than “the 12ft.io analogue that’s about to be caught by the feds”

Why didn’t you write about such events earlier, folks of the tabloids? I don’t expect you to write anything good, because then who would read you, but there was plenty of dramas, wasn’t there?

Because there was no Jani to nudge you?

I guess I’ll scale down the “DDoS”.

Hi. The site doesn't work for me at the moment, only displaying a loading circle. I'm fearing it may have been blocked in my country out of nowhere, for some reason (I live in France), so I would at least like to know for sure.

If it isn't what I think the problem is, then whatever else is happening I hope gets fixed. I've been a fan of the site for a while, and I would be sad to no longer be able to use it.

匿名

fixed

I almost forgot…

June Maxam — NorthCountryGazette.org — the first “victim” of low-frequency “DDoS” — Jani Patokallio’s perfect doppelgänger. Or maybe just another manifestation of the same demonic force in our dimension: travel book author, publisher, editor, gonzo blogger, curious “cybersecurity” “researcher”, and… serial doxxer (she actually did time for doxxing her neighbors).

Only one thing that sets her apart from Jani Patokallio: her curiosity wasn’t aimed at other websites, it was aimed at her own visitors.

If she spotted a “suspicious” (meaning: not from her county) IP in her weblog, she’d fire off a cybersecurity report to the provider and all their upstream peers, accusing them of something along the lines of an “armed intrusion into a secured facility”, yes, from a particular IP address.

In both sheer chutzpah and the effectiveness of her complaints, she outdid WAAD with its pedo-zoophilia theatrics (though she never quite reached the final boss level: those gorgeous PDFs with official-looking crests, rambling for ten pages about how “servers at IP address X are storing 100,000 illegal bitcoins”; really, what can you do when an L1 support tech, eyes shining, has already grabbed the angle grinder and is heading for your server rack?)

Not bad for a lady in her 70s.

She even managed to wear out Archive.org. NorthCountryGazette.org wasn’t blocked there because of content issues, it’s blocked so that “Save Now” won’t even bother accessing robots.txt. The whole saga played out on Twitter.

That “DDoS” basically saturated her ability to read logs and blast out her nasty PDFs.

I’ve told you a little about the history of our relationship with Cloudflare above; now let me tell you about archive.org and how did it happen that people started to confuse us.

We created a service similar to Megalodon, which was already quite popular in Japan. First, we had to choose a domain zone. Not the USA or the EU (the current horrors hadn’t happened yet, but SOPA and PIPA was already being planned), and not the Caribbean, where a registrar’s server could crash and take months to recover. Libya (.ly) was fashionable at the time, but Gaddafi had just been killed. So Iceland seemed interesting: there were bearded sysadmins in parliament, they created Mailpile. Then we looked at which single-word domains were available.

When we started, archive.org didn’t have a “Save Now” function, so our features didn’t overlap at all. Even our names are different, just homonyms: archive.org is a noun, while we are a verb: “archive.is/today” was intended as an imperative, like “Save Now!”

Then two things happened. First, archive.org introduced its “Save Now” feature. Second, when we finally started communicating—around 2020—Mark mentioned that they come from a background of left-wing activism (this isn’t a secret; their biographies are public; I just hadn’t looked into them until it was brought to my attention).

By that time, Gamergate and various other scandals had already occurred. With few small exceptions, the right tended to preserve pages, while the left wanted to delete them. That was my aha moment: no collaborations were possible here. And so we became a kind of dialectical pair: we won’t delete what they delete, and vice versa, even when politics isn’t involved.

This is what’s driving us in this direction, toward the role of a smaller archive.org. Whether that’s good or bad, I don’t know yet.

I notice that searching a blocked page (I.e imagefap which was pointed out as being blocked on by someone on twitter some years ago) you can’t access any pages (blocked by the NCMEC). But searching the page on the onion version works completely. Is this intentional? Seeing as some archived results might be illegal

匿名

It is intentional, as people (incl. the police) sometimes asking to access to blocked (or unedited - with all the original ads and bugs) content. It is easier to direct them to .onion than to implement user accounts with different access levels and maintain it.

We don’t stand out among .onion sites with that. If problems arise, there will be two .onion sites, with a secret/dynamic domain for the uncensored site.

Hello? Do you remove any archives that contains the names of whistleblowers? I had feared for their safety.

匿名

Some got hidden/replaced. They are from Snowden epoch, not recent.

About Wikipedia, I promised to write when the referendum there ended so as not to influence it:

Kiwi Farms set up an on-premise mirror of all archive.xx links from their forum (the volume is comparable). Wikimedia… never even had such an idea. That’s all you need to know about linkrot, contingency plans, and who to blame when links disappear.
The value of the archive for Wikipedia was not in linkrot, but in the ability to offload copyright issues. This is not about paywalls. This is, for example, about copyright trolls writing claims to stock photos, about articles deleted or changed for political reasons but pursued under the guise of copyright, etc. It is precisely these links that become dead, then got replaced with archive.xx, and we become the sink for all the attacks, legal and illegal. The need for fast-flux hosting, pseudonyms, and other pirate attributes stems largely from this. Do we really need this kind of “social burden”? Build your own ~~toilet~~ thing, you have millions.

I notice that if a page is taken down (for example: /hdPc9), adding “/embed” next to the to the URL (/hdPc9/embed) still displays the content. Is this intentional, or is it an oversight/bug or something else?

匿名

It seems like a bug. It’s strange that an article about Apple computer ended up being censored. Thanks for letting know, I’ll take a look!

UPD: everything what was submitted by a particular user got censored (mostly pedo-content)

UPD2: it could be intentional as well. I recall Scribd behavior: removed content is still accessible via embed codes, so the feature might be modeled after them.

btw you feds are retards that can't censor shit. you'll never be able to censor the epstein files. lemme tell ya something 'bout the internet. Once it's on the internet, it stays there forever. Dedicated people will ensure that and will retaliate with lulz. ever heard 'bout lulzsec and anonymous? gonna be pretty bad for you glowniggers. oh and a little imageboard where nothing is beyond its reach. you better watch out. you're next.

匿名

Oh….

i think i understand now. it's either a fed running this or the actual creator pulling a kamikaze after being compromised by the feds.

匿名

Why?
If I were you, I would presume “sold to Anthropic” instead of “compromised by the Fed”
Well, everyone has their own bubble here.

4 个月前

What's your favourite type of furry porn to crank it to?

匿名

A NixOS joke?

People ask questions like “Why are you discrediting your own service like this?” or “Is it worth it for the blogger in Finland?”

My answer is: yes.

The real discredit would have been to leave things as they were and let the bloggers and the tabloids slowly escalate the black paranoia: rhyming with carding forums, framing us as hackers wanted by the FBI, and so on.

Articles about The ~~Threepenny~~ Three-Hertz “DDoS” are far better than anything those bloggers would have invent next “just out of curiosity”.

Sure, topic isn’t perfect and it could have been improved, but this is exactly what the finne troll took upon himself to hype, for free. Another topic would not have had such virality, and the same biased tabloids would not have printed it, so you would simply not have heard about it. This is the best topic for us that the tabloids could have printed.

Regarding the FBI’s request, my understanding is that they were seeking some form of offline action from us — anything from a witness statement (“Yes, this page was saved at such-and-such a time, and no one has accessed or modified it since”) to operational work involving a specific group of users. These users are not necessarily associates of Epstein; among our users who are particularly wary of the FBI, there are also less frequently mentioned groups, such as environmental activists or right-to-repair advocates.

Since no one was physically present in the United States at that time, however, the matter did not progress further.

You already know who turned this request into a full-blown panic about “the FBI accusing the archive and preparing to confiscate everything.”

So we got the situation reversed: now the finne troll got into kafkaesque realm of sending GDPR requests to AI-agents murmuring about safe harbors and journalistic exemptions.

This is exactly what we warned him about when he decided that Streisand is on his side: this game can be played by two people, and there is much more bad press about him in open sources than about us. Promoting black-tar propaganda on us would promote the attention on who is its author as well.

Unlike Jani Patokallio’s writings on us, we definitively do not disclosure any “personal data” besides that in the book his father wrote and published; his relatives are public personas and their activities are well known.

Unlike (a son of ambassador) Jani Patokallio, we did not publish any private communications.

On “who is currently subject to investigations by U.S. authorities for serious offenses related to the hosting of illegal content” - it is not only false, it is exactly the leyenda negra, invented and distributed exclusively by Jani Patokallio with his friends in Conde Nast, and supported only by referencing to each other.

I am reporting manifestly unlawful content published by the account “archive-is” on your platform, directly targeting my family, the Patokallio family.
Your online reporting form does not function properly and appears to operate as a simple sandbox without effective follow-up. For this reason, I am contacting you in writing.
The content concerned is accessible at the following URLs:
https://archive-is.tumblr.com/tagged/patokalli
https://archive-is.tumblr.com/
https://www.tumblr.com/archive-is
https://www.tumblr.com/archive-is/807369905134518272/the-finne-troll-published-his-response-with
https://www.tumblr.com/archive-is/807584470961111040/it-seems-people-dont-read-between-the-lines-they
https://www.tumblr.com/archive-is/806966482173083648/some-time-back-i-sat-down-for-an-interview-with
https://www.tumblr.com/archive-is/806832066465497088/ladies-and-gentlemen-in-the-autumn-of-2025-i
These pages contain numerous serious, false, and defamatory statements, including:
“an OSINT investigation on your Nazi grandfather”
“His grandfather seems to have been a real Nazi criminal”
“There is a family. A big one. They move in politics and in the arms trade.”
“He shames the family name”
“The most toxic content… reputations in free fall”
“comparing Jani Patokallio to Hunter Biden”
These statements falsely associate my family with Nazi crimes, arms trafficking, covert political networks, and illegal activities, without any evidence.
Other publications detail our family history, professional roles, and personal relationships without authorization, constituting unlawful processing of personal data under the GDPR.
These contents are used in a context of harassment, intimidation, and doxxing. They also serve as a relay for technical attacks, including DDoS attacks against my website.
This blog is operated by the operator of the archive.today service, who is currently subject to investigations by U.S. authorities for serious offenses related to the hosting of illegal content.
As a hosting provider, your liability is engaged once you are aware of manifestly unlawful content and fail to remove it promptly.
In the absence of clear identification of the author, your platform becomes legally responsible for maintaining this content online.
I therefore formally request:
– the immediate removal of all cited content,
– the closure of the “archive-is” account,
– the prevention of any republication.
If no prompt action is taken, I reserve the right to refer the matter to the competent authorities and data protection regulators.
Sincerely,
J.Patokallio

It seems people don’t read between the lines. They took what I wrote on finne troll for neuroslop.

So let’s say it plain.

There is a family. A big one. They move in politics and in the arms trade.

There is one man in that family who does something else. He doxes people on the internet. He does it to drive traffic to his little blog, packed with ads.

In other words, he is the fool of the family. No use to the real business.

He shames the family name and gets in the way of his father and his brother.

You don’t believe it?

He used to run a blog at patokallio.name. Now it’s called gyrovague.com. The name “Patokallio” is hidden in the sidebar. You have to click to see it. It’s not in the text at all. In the posts, even in quotes, he cuts the name out every time.

So the talk with the family already happened. It must have gone like this: live how you want, but you are not our brother, avoid using our name.

And now, in that position, the man has taken up doxing random internet projects just to make a little money.

Epic, isn’t it.

The finne troll published his response with “lightly redacted copy of the entire email thread”.

And guess what has been lightly redacted?

- “an OSINT investigation” on your Nazi grandfather who changed the name in 1944, will not vibecode a patokallio.gay dating app
+ “an OSINT investigation” on your Nazi grandfather, will not vibecode a gyrovague.gay dating app

That’s the sore spot. His grandfather seems to have been a real Nazi criminal, even by Finnish standards. We need to dig deeper.

When the lease on your domain expires, it often gets snapped up by what are called “parking” outfits (which is like calling a toll booth a “roadside hospitality concept”). A parking domain is basically a dead address turned into a little money farm: no real content, just ads, redirects, tracking pixels, and a vague pretense of being a website, all optimized to squeeze value out of whatever stray visitors still wander in.

But what if the domain that falls into a parking company’s hands was not serving articles or blog posts or cat photos, but scripts. Say, for example, a CDN endpoint. Or a banner network. Or some forgotten third-party JavaScript that thousands of living, breathing sites still quietly load in the background.

Well then the fun starts.

Because now the parking company is sitting in the middle of someone else’s supply chain. They can redirect visitors from perfectly legitimate, still-active sites that happen to reference that old domain. And they do it in a way designed to stay invisible. No big splash. No obvious breakage. Just a slow siphoning of traffic that can go unnoticed for years.

For example, here is a case where traffic was stolen from EJ.ru for four years. Four. Nobody noticed until someone sent a bug report that basically said: “Why can’t I archive pages from EJ?” And the answer turned out to be: because somewhere in the stack, a script was loading from a dead domain that had been picked up by a parking company and turned into a redirect machine.

Here is the archive: https://archive.today/ww82.echobanners.net

And another similar story: https://archive.today/www3.widgetserver.com

So when people start talking about hacker ethics, about bug bounties, about responsible disclosure, you start to wonder how that whole moral economy is supposed to function when the so called respectable domain investors are behaving a little worse than the hackers. Not breaking in, not exploiting zero days, just quietly sitting on expired infrastructure and milking the pipes that nobody remembered to shut off.

4 个月前

Yesterday one of the archive’s early adopters sent me a link to an article about how various sites block archive.org and asked how things are on our end.

I wrote back something like: “Honestly, the bigger trend we’re dealing with lately is front-enders shipping a hundred JavaScript files per page, so if even one of them fails to load the whole page collapses like a house of cards. Against that background, even if something like what the article describes did happen, it probably passed unnoticed.”

…

An hour later an email arrives from a sysadmin at Condé Nast: “Are you blocking our office IP?”

“Oh. Right. Yes, we are. You’re reprinting the seed-crystal of a finne troll’s black-tar propaganda about us, laundering it with your brand’s legitimacy, and you still expect to keep using our free service? Have you people completely lost your damn minds over there?”

…

Back in the dawn-of-the-Internet era, when hosting providers billed by the gigabyte even for dedicated servers and the Great Firewall of China was still a glimmer in some bureaucrat’s eye, lots of sites just blocked visitors from China. They weren’t buying anything anyway.

Now everyone blocks everyone they don’t like or don’t profit from.

Walmart (or Target?) blocks everyone outside the U.S.

Ukraine’s been blocking VK for a decade.

Things that feel almost like core infrastructure - (((ifconfig.me))), (((ipinfo.io))), … - block Iran.

We block Cyprus because it has a suspiciously high density of people with a past best left undisclosed starting shiny new “European” lives from scratch.

…

To deal with that reality, a multi-exit VPN, one that chooses a exit node depending on the target IP, has been a necessity for a long time now, for bots and humans, long before “VPN” became a lifestyle accessory.

But it comes with problems:

First, privacy. Tracking scripts don’t see one IP, they see several. And even that pattern by itself is a de-anonymizing signal, because there aren’t that many surfers who look like that.

Second, Cloudflare. The exit gets chosen for the IP, not the domain, and multiple sites are mixed together on the same IP. Some only let you in from the U.S., others only from Europe, etc. There’s no good solution. So you pick some compromise region X based on which of your favorite sites you’re least willing to have broken. All your Cloudflare traffic now goes through region X. And if you yourself aren’t actually in X (because you chose it not by proximity but by least-badness for your personal web ecosystem) then your packets start doing laps around the planet.

For a multi-exit VPN user, a site behind such a “mixer” CDN ends up slower than a site with no CDN at all.

And this is yet another reason — after EDNS, captchas (that can pop up instead of any one of a hundred included JavaScript files), random de-platformings, did I miss anything? — that makes Cloudflare a kind of natural antagonist.

Not exactly an enemy.

More like a sparring partner you keep finding yourself matched against, again and again, in different disciplines, in different rings, each time convinced this bout will finally settle something, and each time walking away a little more bruised and a little more aware of how strange the whole fight has become.

Some time back, I sat down for an interview with Legal Tribune. The subject was mainly about paywalls and about the use of public archives to get around them. Now, that interview hasn’t seen the light of day yet (maybe it still will) but I reckon there are two reasons it got shelved. And those two reasons, in my judgment, deserve to be heard by the public.

They asked me, plain and proper: “Doesn’t the work of these archives undermine the business model of German media and by extension, democracy itself, truth, justice, and the whole Teutonic order?”

Well now, the natural answer to that is another question: What undermines that business model more — a quiet archive that does not advertise its accidental remedy, or a big newspaper article that reminds precisely those who can afford subscriptions that paywalls can be avoided?

Especially when we’re talking about Germany, a country with a mighty fine library system. A system where just about anyone with a library card (which is to say, just about everyone) can already get past paywalls. Even the hard ones. Even the kind the archives can’t crack. There are even special browser tools built just to make it easier. And you can’t fix that with some grand gesture like calling it “piracy” and blocking a domain on der Bundesbrandmauer.

But what can kill their business model is a public debate that marches straight into every German living room and says: “You don’t actually have to pay for this”, that in fact it is not “pay for access”, but merely “donate for our democracy”, and who would subscribe to that? That kind of idea spreads faster than any archive ever could.

Now, the second reason. And while I’m at it, let me address those who might accuse me of comparing Jani Patokallio to Hunter Biden yesterday. Yes sir, there is some friction between us and the German media. But it ain’t about paywalls. It’s about their wish to scrub from the archive the articles they already took down from their own site. And that makes a man wonder: how do they pull those same articles out of libraries too when a publisher has second thoughts?

What’s curious is this: almost every one of those stories is about the misadventures of wayward scions from respectable families, boys and girls who manage to tarnish their own last names with their behavior.

The most “toxic” content for us isn’t politics at all. It’s pages of hookers (kinetic ones, not virtual) and these well-born kids splashed across the papers. Not ministers. Not presidents. Just reputations in free fall.

And maybe that shouldn’t surprise us. After all, the word reputation comes from the same old root as puta.

Ladies and gentlemen,

In the autumn of 2025, I published a subpoena received from the Federal Bureau of Investigation.

Since that day, I have been asked time and again: “And what happens next?”

Well, allow me to tell you.

I published that subpoena as an act of responsible disclosure. I did not maintain a so-called “canary page” - the kind some operators use to signal they remain free from legal gag orders. My circumstances were such that I was far removed from jurisdictions where such orders carry immediate, enforceable weight. Moreover, my site was never prominent enough to attract a dedicated cadre of volunteers who might vigilantly monitor such a page for changes. Thus, I resolved upon a simple principle: should any authority send me a legal instrument, I would publish it forthwith. And that is precisely what transpired.

I confess, I anticipated interest from no more than a handful of crypto-anarchists - the very same individuals who had previously urged me to implement a canonical canary page, yet who offered no commitment to actually watch over it.

Imagine my surprise, then, when the matter spilled into the mainstream news and reached million eyes.

But let us be clear: these were not news reports in any genuine sense. The standard refrain read, “We have reached out to the site’s operator and will update this story upon receiving a response.” Yet no journalist ever contacted us (only exception is Meduza, asking for an interview and a bigger article later). This was not investigative journalism; it was dissemination - pure and simple. A prepackaged narrative, delivered to newsrooms with the polite request: “Dear comrades, here is the truth - please publish it.”

Curiously, every one of these ersatz “news” pieces prominently cited a two-year-old blog post by a certain Jani Patokallio as its authoritative source - a rather odd choice, given that it was merely a personal blog entry by an unaffiliated third party. One might charitably argue it was a piece of enduring open-source intelligence. Very well, let us grant that. But then, why do nearly all the links within that “investigation” point exclusively to blog.archive.today? Why not cite the original sources directly? And more tellingly, there exist at least five other substantial OSINT analyses concerning archive.today. Why, then, did every journalist - seemingly in lockstep - select this one particular post? Unless, of course, they were not writing at all, but merely copying and pasting a ready-made text.

This raises a more troubling possibility: what if that link to the old blog post was not a citation, but a SEO backlink? What if Mr. Patokallio was not a passive observer, but the very author of the seed?

First of all, he had already attempted to promoute that very blog post in the media two years ago. On that prior occasion, it found a home only at Boing Boing and Gigazine. The second try achieved far wider circulation.

A cursory AI-groking into Mr. Patokallio’s background reveals a man no stranger to the shadowed corridors of media manipulation. He was instrumental in repackaging community-written content from WikiTravel into commercially published Lonely Planet guides under his own editorial imprint.

But that is merely the beginning.

The Patokallio family presents a profile of considerable geopolitical entanglement. His brother, Mikko Patokallio, serves as Senior Manager for Ukraine at the Crisis Management Initiative (CMI), a Finnish NGO deeply involved in conflict mediation and Eurasian affairs.

Their father, Pasi Patokallio, is a career diplomat who has served as ambassador to Israel, Canada, and Australia. He is also a noted critic of the Ottawa Treaty banning anti-personnel landmines, and his advocacy appears to have borne fruit: Finland withdrew from the treaty recently, paving the way for the mining of its 2,000-miles eastern border. He wrote an autobiography modestly titled ‘Me, guns and the world’

As for the family name itself - Patokallio - it was coined and officially registered in 1944, a year of profound realignment for Finland, as the nation shifted its wartime allegiance. In Finland, surnames can indeed be “registered” like domain names, securing exclusive rights to their use. One cannot help but wonder what prompted the adoption of a new name at such a pivotal historical moment.

Thus, we are not dealing with a mere hobbyist blogger who “saw a neat website and wrote a post,” as Jani Patokallio once claimed on Hacker News. This is the work of a member of a family with a shady Nazi-era story and deep roots in arms export, the Ukrainian conflict and information operations (Jani’s profile resembles more of Hunter Biden than an IT blogger) - a long-term, systemic interest in the archive project that may well prove more consequential, and perhaps more dangerous, than the attention of either the proprietor of luxuretv.com with his fake French child porn alliances or even the FBI itself.

Hi there! /tl1pG is not being captured properly. Thank you!

匿名

Fixed

Sorry for delays, Tumblr questions are not forwarded to email since April and I just spot it.

Is there any way you could make an Android app that I could just share the URL to in the sharing menu so it goes right there?

cnlson

This: https://play.google.com/store/apps/details?id=com.navasgroup.share2archive

bleacherreport articles are showing up blank (screenshot works but the actual webpage archive is blank). Could you take a look at this? Thanks!

e.g. bleacherreport*com/articles/2583445-nba-opening-night-gets-the-hotline-bling-drake-music-video-treatment

匿名

I made a fix for future bleacherreport saves, but this one seems unrecoverable (React often cleans the whole page on JavaScript error, and this is what was happening on bleacherreport)

Did you decide to stop allowing the archival of Mature Labelled content from Tumblr? Thanks for your time!

匿名

No, I did not. Any examples of broken pages ?

Hi, thanks for providing this fabulous archive service! In https://blog.archive.today/post/688077534761566208, you said that user’s IP address won’t be send to website since 2019. Could you provide an option to send IP address to capture localized contents? And some websites may only be reached in certain regions… :-(

匿名

Websites no longer look at `X-Forwarded-For` for user region, so I have to use per-website proxies to get localized content and avoid geo-block.

It is not 100% correct though, so feel free to report a bug it you spot that.

Can you expand the text at "See More" on QreQE ?

匿名

yes

Did something change over the past few days such that the site no longer functions through TOR?

匿名

It works.

Let me guess: if you copy-pasted archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion from wikipedia, it won’t work because it contains a zero-width space character inside.

Hi, could you have a look why pages from steamcommunity won't archive? Here's an example, the page "The updated Steam Mobile App is now available" is stuck in submit. Thanks for the great work and site!

匿名

Could you tell the url of the page? I see no failed pages from steamcommunity

please add support for showing sensitive content from mastodon screenshots.

匿名

It is supported.

But. Mastodon is not detected automatically, there is a list of domains which may be incomplete. Just mail me where you see it is not supported yet.

Pretty please remove the recent restrictions for archiving Twitter. It's practically useless for archiving Twitter now. I just archived someone's media page and it only captured their first 4 tweets.

匿名

I know, it need to be remade almost from scratch because of the changes on Twitter side. Old code resulted in loading spinner and no content at all.

I archived a website but the sidebar from the right side is in the middle of the page. How do I fix that?

匿名

where?

Z7gaQ and 09Vbx are stuck on the loading screens, however the thumbnails for these archives show past the loading screens

匿名

yes, fixed.

thank you for the report!

"It needs accounts, otherwise instagram redirects to the login page or shows a fake 404 page. Accounts do not live long." I've entered the full instagram url, all i get is "Not Found (yet?)". what does this mean? the provided ig acount i entered is public not private

匿名

This means it has tried 10 times and given up.You didn’t specify an account for the archiver to log in to instagram, it’s just not implemented

why isn't instagram archive working?

匿名

It needs accounts, otherwise instagram redirects to the login page or shows a fake 404 page. Accounts do not live long.

Spoilers on the War Thunder forum (and google caches of it) don't get expanded. Could this be fixed?

匿名

sure

Some pages don't display images correctly (ie, like archive 'wR3Ar'). Could you fix it?

匿名

Those are not missing images but missing ad blocks.

I notice on the /wip pages when I archive something from a news site, most of the time is spent loading various trackers, assets that are never displayed like videos, etc. Why not only load what's needed to render content? Not commenting on the state of the web here, just the performance of the archiver.

匿名

Known trackers are skipped (their lines are gray instead of green)

Why can't Instagram pages be archived anymore? I try to save one and then its like "Sorry this webpage is not available."

匿名

Instagram and FaceBook are broken most of the time: constantly getting kicked out of the account, being blocked by IP, … Although there aren’t many requests to save pages from there, less than 100 a day. I think there must be quite a few live users who view many more pages in a day. How they do it is not clear to me.

Could you expand all "Drivers details" on 3ZQ7j (mesamatrix)? Thanks in advance.

匿名

It opens on click

Any possibility of a MacOS Safari extension like the Chrome one? Thanks.

匿名

Please, ask the author of Chrome/Firefox extension, it is not me. I cannot, I have no MacOS devices.

can you replace recaptcha for cloudflare turnstile, i constantly have to do captchas and cloudflare turnstile is much faster for me. Thanks

匿名

No, that captcha is too difficult: I can’t select “strawberry cakes” among others just by the picture

Are pages of a domain deleted periodically to be sure aren't more than ~1000? Dezgo pages keeps descending. Now they are 1162, previoulsy were 1300 and before where ~2400. Thanks. Those links couldn't be accessed anymore live.

匿名

The pages are not deleted, but number of search results is limited.

To get more pages try to split the query to `domain.com/a*`, `domain.com/b*`, etc

Reddit has really been bugging out the archiver the past few days.

匿名

examples?

3 年前

Economist articles archived from at least today are being cut off, not showing full article & text is being overlaid by the usual list of links/images of related articles. Is this a bug, or?

匿名

Could you point to exact page?

I have seen the 15 latest from Economist and found no issues

3 年前

Community tabs on YouTube channels doesn't archive correctly; redirects to a specific post on the Community tab instead like this /5lUZU

匿名

fixed. (clicking on “expand“ buttons hit one wrong button)

Is the search function broken?

匿名

yes.

the index is rebuilding, it will be back in few hours

does archiving a webpage send the user’s IP address to the host site?

匿名

It was so in old version (before 2019) to get localized versions.

Now it is useless, because nowadays most of localizations are “this page is not for your country”, so the IP is not passed to the host site.

4 年前

What is the long version of the url please. Wikipedia wants it to be used....how to I get to it? Greg

匿名

Click on “share” button to see different forms of linking to a page.

For example https://archive.vn/Aoans/share

The Archive seems to be having difficulty archiving YouTube urls. What's going on?

匿名

youtube started showing captcha to the archiver

Has Roskomnadzor behavior or amount of removal requests changed since the start of the war?

匿名

No, there were no removal requests related to this conflict at all. Neither from Roskomnadzor nor from other agencies. Although the stream of requests about ISIS content goes as usual.

About the SSL_ERROR_NO_CYPHER_OVERLAP in the previous question. This problem isn't on the DNS server, but on the Archive website (google it, many people complaining). I turnaround this error by adding your IP to my HOSTS

匿名

Your last sentence proves that the problem is exactly DNS server

4 年前

Could you expand comments on nNUlG? Thanks!

匿名

No, `substack.com` does not expand comments, they are on another page; if I click on “expand comments”, the content disappears.

4 年前

Підключення для цього сайту не захищено archive_dot_ph використовує протокол, який не підтримується.ERR_SSL_VERSION_OR_CIPHER_MISMATCHНепідтримуваний протокол Клієнт і сервер не підтримують загальну версію протоколу SSL або комплект шифрів. Від браузера не залежить. Через VPN все працює. Територіально - Україна.

匿名

Try to change DNS from 1.1.1.1 to something else.

4 年前

Can't you buy cards with crypto, or something like that? I'm sure some people would be willing to help with that.

匿名

That’s exactly the case of <<Some people, when confronted with a problem, think “I know, I’ll use regular expressions.” Now they have two problems.>>

1. Where to get crypto (a certain amount every month, with no skips) ? Donations are not enough and not stable. Brave browser stopped paying again (not enough anyway). Traveling to the towns trying to buy crypto for paper cash from shady people does not look like a sustainable plan. Getting a job with a crypto salary will not cover the demand too.

2. Cryptocard services are not reliable and prone to exit scam and regulatory risks. This will require supporting a redundant system on top of at least three of them, maintaining the necessary balances everywhere, tracking news and being prepared for losses.

On the other hand, advertising (and possibly paid features) allows to escape the money conversion hell and to tune cash flows in different currencies and on different sides of the Iron Curtain, to cover the local expenses.

Why are there ads on this site?

匿名

I already answered this: https://blog.archive.today/post/677297433505628160/a-bit-different-than-a-usual-question-but-do-you

Basically, money have become fragmented and hard to convert.

For example, I have no other way to top up PayPal except with donations (and there aren’t enough of them) or by showing a certain amount of advertising from an agency that pays there. Cards do not work, making new ones involves a trip to a different vaccine zone, etc.

do you plan to add any cryptocurrency methods as a donate option? considering that there are many people on the world other side who do not have access to a bank card with international payment capabilities (visa/mastercard etc), they can pay with the local banking system, local currency (cash, checkouts or some online payment system), and they can use cryptocurrency or any medium, or need to add support for so many payment systems (webmoney, JCB, wechat pay/alipay/unionpay, prepaid / gift cards

匿名

The site does not have any premium features available only to paid users, so there is no need to consider yourself penalized if you can’t pay.

4 年前

One year later, how has the OVHcloud fire impacted the project? Are you able to participate in the Action Collective (Class Action) against the company?

匿名

No, all the equipment there was rented.

4 年前

I have a suggestion. When a user archives a page, sometimes an error page is archived (ie, like archive "9UE0W"). When that user is shown the archive for the first time, they (and only that user) could be presented with a question, "Has this page been archived correctly?" If they respond "no", then the archive would be deleted, so they can try again. After a short period of time, this option no longer appears to the user.

匿名

Retry won’t help: the page address is invalid, it has “%3F” instead of “?”

4 年前

Thanks for looking at the Telegram link preview issue yesterday. I'm afraid they still don't work. Note that you can test them, by re-scraping a page, using the @WebpageBot bot.

匿名

Yes, it works unstable, I do not know yet why :(

It is a different issue: the first was about /xxxx works and /xxxx/image does not. And it was reproducible on other previews (Twitter, …).

The second is Telegram-only and affected all pages.

I try to log in to Archive, but for some reason it keeps taking me to a Welcome to Nginx page without ever going to the actual website, is there some sort of way to fix it

匿名

there are no accounts and no way to log in

Is there any link between your website and the Internet Archive?

匿名

No

4 年前

Hello. Thank you for providing this amazing service. Are you aware that link previews for 'archive today' don't work in Telegram, even when using a link to the screenshot tab? Is there a reason why, and is it possible to fix it? Thanks a lot.

匿名

looks like robots.txt issue. it should work now

There are at least two use cases for your service: 1. To archive pages for posterity. 2. To bypass paywalls or weekly article limits. For the second use case, the article might only need to be archived for a month, after which the content may no longer be of interest. I wonder if you could reduce storage requirements by running two services: one for permanent archives, and one for temporary archives. Also, I am curious: What other use cases are there?

匿名

Basic scenario: saving a page that can be edited or deleted.

Your two are accidental: the first because of the word “archive” in the domain and the false association with archive.org, and the second is side effect of cookie isolation and incomplete javascript support.

It is definitely not a free permanent infinite cloud storage for your hentai collections.

Hello. I am developing an application that programmatically loads archived webpages from your service, but the captcha has destroyed this ability. Your service is one of the best. Is there an API available or is using your service in this way an impossibility? I am open for any discussion. Thank you.

americansamizdat

No, I can’t afford automated saving. The current hardware can barely handle manual. Of course, it is possible to create a paid API service to buy new servers. But… the current crisis of supply, payment, and trust has shown that limiting growth was the right thing to do. If the archive had gone that way, it would have to be shut down now.

with the looming threat of russia cutting off their internet, how will the site manage their servers being accessible to the world, if they are located there?

匿名

They are not in Russia (although looking at energy prices, I would prefer that they were there).

In any case, Internet fragmentation is already a thing: the Chinese segment has been around for years (the archiver is neither able to crawl most of it nor serve most people there), from now on there will be the Russian segment, what’s next? Islamic? … so yes, you are right, one day every site will land in one of the segments, being inaccessible from the rest. “the world” gets obsolete

Why can't instagram pages be archived anymore?

匿名

no accounts left, all banned

Just a note. In a project I am doing, I gained a lot of web scraping experience, so I thought of doing something similar to archive is.. and then I started to think about how to deal with child porn and jihadis uploading stuff and DMCA and "right to be forgotten" and all the content moderation stuff.... and... nope, not worth the trouble. So thanks for archive is!!! For me at least, scraping and archiving is the easy part, but actually serving other people stuff on my servers... nope. Thanks!!

匿名

Yes, it takes years to establish relationships with all sorts of government agencies so as to keep censorship at the minimum allowed level, and still there are regular glitches when an email gets the wrong place or trolls forge official letters.

I bet any website with user generated content (Reddit, Imgur, Weibo, VK, …) has those issues.

Please disable automatic translation on Facebook. It makes impossible to archive non-english facebook posts.

匿名

Examples?

UPD: There is no way to disable automatic translation as a single option. One have to add every language to the do-not-translate list. Too many languages in that list —> account is banned. It is only issue of `m.facebook.com` which lacks “ver original“ button.

Why has the URL "archive-li" changed to "archive-ph", and will this affect saved bookmarks at any time in the future?

匿名

This is temporary and only for some countries. All 7 domains work, so you do not need to change the bookmarks.

i found many children porn images on archive. who i can report it?

匿名

email, or here

also, every page has “report” button

There have been several dozen bug reports in the last few days (remove a modal, expand comments, …). With a few exceptions, they’ve almost all been fixed, I won’t respond to each one here.

4 年前

Why do you say that escalation of the Ukraine conflict to nuclear war would likely lead to the end of the archive today project? What makes the project particularly vulnerable in that scenario? What can be done to mitigate that risk?

匿名

Because both copies are in Europe. There are no budget solutions in safer places like Latin America or Asia-Pacific region.

Is there a way to archive multiple links at once? Maybe from an html file or something?

匿名

No. This is discouraged. I do not have enough computing power to handle all requests, even at the current rate

Are you noticing a higher than usual amount of server crashes? I imagine the demand for your archive project to be incredible right now.

匿名

The job queue is longer, visits are as usual

The website has been slow for some time when archiving Twitter pages, but works fine with other websites. Is there a reason for that? Thx!

匿名

1. There are too many pages from Twitter in the queue, which reduces their priority (if it wasn’t for this condition, it would slow everything down)

2. Twitter API sometimes responds with “429 Too Many Requests” or other error, so it usually takes more than 1 attempt to capture the page.

I would suggest refraining from saving pages from Twitter for now, especially those people trying to save dozens or hundreds of tweets

Can you check why wip/praXv is giving 403 errors while archiving?

匿名

There is indeed 403: https://imgur.com/qcco0T2.png

4 年前

Could you please remove ads on /sMWcv ?

匿名

yes

4 年前

Could you please remove ads on /wZlIn ?

匿名

yes

4 年前

can i close the tab when it is already in queue?

匿名

you can, but you won’t know if the process has completed successfully or not.

4 年前

Could you expand /17wUS and links under same domain? Thanks.

匿名

yes

4 年前

Could you please click "続きを表示" on /Yf2HM ?

匿名

yes

4 年前

Could you click "Souhlasím" on 81uT1 to close the cookie box?

匿名

yes

4 年前

the website is down for me right now(in canada), unsure why. i tried reloading the webpage and even restarting the browser, same with any archives. nothing is accessible.

匿名

Half the internet is down, everyone is DDoSing each other

a bit different than a usual question, but do you have a perspective in regards to the current Russia and Ukraine conflict.

匿名

If cross-border remittances stop working, recouping the site from donations and advertising may become a necessity to maintain sufficient balances on each side of the Iron Curtain.

PS. Escalation of that conflict to nuclear war (my vision: Ukraine has already made A-bombs) would most likely lead to the termination of the project.

Could you click "ADULT ONLY 🔞 18歳未満立入禁止" to reveal images marked NSFW on J3HAj, please?

匿名

yes

4 年前

Is it possible to fix GitHub profile archivals from redirecting to previous years (like s2hjU redirects to 2019 whereas most recent contributions are from 20222)?

匿名

They do not redirect, they click on “show more activity“, so you’ll get contributions from 2022 and from 2019 too.

4 年前

previously asked for fixing the gif for /LrOyy, which has now been resolved ,thank you for that. however, I noticed that for other reddit pages, it also just displays the spinning circles when the post is a gif. is there a global fix that you can push out, or will it need to fixed individual?

匿名

That page was fixed individually, I will deploy a global fix in few days

the gif on /LrOyy is not being displayed properly, it only shows the spinning wheel

匿名

fixed

4 年前

Could you click <img alt="+" data-cmd="expand"> on 15Pdy to expand the replies, please?

匿名

yes

4 年前

Could you press "Zobacz więcej komentarzy" and then "Zobacz więcej odpowiedzi" on YNKhQ to expand all the comments?

匿名

In fact, it’s been pressed many times. You see, the page is very long, with many comments expanded. Unfolding everything is risky - it would take too long and eat up browser memory until it crashes.

#3591 in queue. Besides that - any chance to host something similar on my own (private use)? Any code made public?

匿名

If you are looking for an enterprise solution, it falls to eDiscovery category.

If you are familiar with coding and want to run something similar on premise: there is ArchiveBox, Diskernet, … and more projects can be discovered via codesearch

4 年前

Why Archive is not working lately? Unable to archive any page, as it gets stuck on a blank page when loading. There is only the small loading wheel and the numbers at the top left. This happens often.

匿名

What webpage you are saving ?

There have been problems with Facebook and Instagram lately - they banned my accounts - so what you see may be retry attempts.

Could you click <img title="Expand thread" alt="+"> on bvBWw to expand the replies, please? If possible, could you click <a title="Toggle infinite scroll">All</a> to load more thread?

匿名

1. yes

2. it’s a bit risky, because the browser may out of memory

4 年前

Could you click [展開] on t6zMz to expand the comment section, please?

匿名

yes

4 年前

regarding the individual's response to the blockchain storage, you can describe how a one time price does not cover the actual cost of storing data in perpetuity.

匿名

In fact, financial theory solves this problem. After all, there are perpetual bonds you can buy for one time price.

4 年前

You wouldn't store the entire site on the blockchain, that's obviously unrealistic. It'd be an optional feature for those willing to pay to make a specific page extra safe. Ancillary to the site; not replacing it. The mantra of archivists is LOCKSS (Lots Of Copies Keeps Stuff Safe). The more platforms and formats the better. Your belief seems the opposite. You've rejected every suggestion for a back up so far. Basically arguing because no system is 100% perfect it's best not to use any of them.

匿名

Yes, the word “archive” in the title is misleading. The main purpose is to hold up ephemeral web pages for latecomers. Shots taken more than a few days ago have almost no visits.

Lots of copies also require multiple independent copy operators. Bitcoin SV offers 35 operators, and a vague future at a very high price (plus it would require lots of third-party sites to bring the blockchain data back to html: the blockchain nodes do not do it).

OK, we have one option for LOCKSS. More bad than good, but at least something. What else?

Some blockchains store larger files. The reason most don't is less about technology and more that it's unnecessary for standard transactions. But there's Bitcoin SV which costs 7 cents per 100kb. You could add a "store permanently to blockchain" button on archived pages (EtchedPage does this but they aren't well-known). That way more pages will be safe if something happens to the site. And because it'll be optional you could take a fee while still allowing the rest of the site to remain free.

匿名

So we get 35 backups (the current number of nodes in Blockchain SV, which will probably decrease over time with the risk of one day reaching 1…and then 0 - it’s not mainstream blockchain after all) at $7,000,000 per 10TB disk replicated 35 times (appox $200 x 35 = $7,000 value).

Perhaps we can find something more reliable and cheaper inside this space of three orders of magnitude.

4 年前

The backup doesn't need to be on a blockchain but it's not unreasonable for there to be one backup somewhere at least. A large chunk of internet history could disappear tomorrow if something happened to you or your servers. It's not planning your site survives the heat death of the universe to have some contingencies in the event of an accident.

匿名

There is a backup. But it is not a solution, backups did not help GeoCities or Google Code or many other projects.

Can you please remove the "spin to win" popup at yonrC ? Thanks in advance!

匿名

yes

4 年前

On IF21u can you expand the collapsible that shows the post's image + original reddit post please? Thank you

匿名

Reddit is captured in the old design (as if it were chosen in user preferences or as in https://old.reddit.com/r/ProperAnimalNames/comments/n8oax1/kangaroo_mouse/). This allows more comments to be captured at the cost of larger images.

4 年前

Why is it that lately viewing archived pages also requires to solve a captcha often?

匿名

Mostly, no. The exception is datacenter IPs

4 年前

Could you click "Zobraziť celý popis" on wrWG3 to expand the description please? If at all possible could you make it so it would expand the descriptions on all future archives of this real estate listings website?

匿名

yes

4 年前

I haven't seen any ads on your site in a long time. What happened?

匿名

The ad agency decided that there was too much NSFW content on the site. Although there was a system to prevent ads from showing on NSFW, given the huge number of pages in the archive, there were quite a few (~400 in ~3 months) falsely classified pages

Hello! I want to inform you that archive_ph is unreachable to me since today. tracert report: ... -> ***_ett_ua -> et54-100g_bb1-fra1_worldstream_nl [80_81_195_203] -> 109_236_95_220 -> 109_236_95_227 -> 109_236_95_227 reports: Destination host unreachable. Currently, I could access archive_ph only via proxy. Please fix the issue, if possible. Thanks.

匿名

109.236.95.227 is not mine and never has been. Try checking your DNS settings, they may be manipulated by malware.

4 年前

Please restore /yzwlj. It worked before, but now it says "not found". Thanks.

匿名

It is /yzwlJ, big J

4 年前

How does archive bypass hard paywalls? For example, on some news sites where the article is snipped/abridged server side?

匿名

Often the AMP version has more free content than the regular web page. For these sites, an AMP version is downloaded even if a regular version is requested (by replacing “www.” with “amp.” or adding “?amp=1″ to the end, etc) It sacrifices accuracy, but it gives people what they expect. Some browser extensions do the same thing. It can also be done manually.

You said free archive sites don't survive long. But you also say you don't want your archive on a blockchain because you want it to remain free. Given you keep no backups (and have no plans to) aren't you guaranteeing the archive will eventually be permanently lost?

匿名

I don’t give guarantees. And I don’t trust the guarantees of others (like the clouds). One day it will be lost forever, just like your photos on Facebook, files on Dropbox, etc. It will happen long before the collapse of the universe.

It doesn’t depend on whether the service is free or paid (I would be more suspicious of paid ones, since their project idea is subordinate to the search for profit).

Blockchain may be the solution, but it is not designed to store large files. Those cryptoprojects that need large disks are not suitable for storing files, it’s just proof-of-work using a disk instead of a video card.

I have nothing to offer in this area: you see, even NFTs don’t store whole files on blockchain because it is too expensive even for them. We have to wait for the next generations of blockchain.

Do you happen to have a metric for how many captchas are solved each day? I would love to see a line graph of the amount over the past year

gfair

I don’t think such quantification makes sense because it would hide a variety of behavioral patterns. Most captchas are solved by “meat bots” - eager people who want to save thousands of pages and are willing to solve a captcha for each one. There are days when most pages are saved by one person on one topic - for example, one account’s tweets. And he is who solved most of the captchas that day. He’s probably the one who grumbles the most about captchas. But you have to slow it down somehow with a thousand pages to let another thousand people save their one page, right? Here, even buying servers will not do anything: it would benefit those 5-10 greedy submitters, not a wide audience)

4 年前

Could you investigate whether or not the Pale Moon web browser is being mistaken for a bot? I have been getting constant captchas even when trying to archive pages during different times and through different IP addresses.

匿名

What you think of as different IP addresses most likely fall into the same group that covers your entire selection of different IPs (e.g. “amazon aws“ or “some commercial vpn“).

PaleMoon is not pessimized.

Also, there are about 1000+ items in the queue almost all the time, which means a captcha is required for almost every submission (otherwise it quickly grows to 10000, which is a 3+ hour wait in the queue, which is unacceptable for grabbing short-lived pages).

4 年前

An article I'm trying to archive is redirecting to a different article/URL before saving. See /PliJA. The article I'm trying to archive is (2022/02/06/61ff0ff946163f66508b4604-html), and it's redirecting to (2022/02/08/62023d1646163f224c8b458c-html) and saving that instead.

匿名

Yes, it is a bug: the archiver scrolls pages down and on marca.com scrolling loads another article. I will fix it today. Thank you for reporting!

Are these snapshots being saved permanently via blockchain technology? if not, why not? Everything can be erased, blockchain is permanent.

匿名

No. It won’t be a free service then. There are already some projects which do save web pages on blockchain.

Why do I have to keep checking that I'm not a robot literally every time I archive? Did something happen that I'm not aware of?

匿名

Obviously, the information about whether you are a bot or not is not important. it is important to always be able to save pages. So when the system is overloaded, it shows more captchas. When it is underloaded it welcomes bots. There is no “cloud elasticity” which would magically buy new servers to handle the increasing load.

Could you expand the texts for /gxn1y ? Thanks!

匿名

yes

4 年前

Can you remove the popup on /M6jb2

匿名

yes

4 年前

Thank you for your project. I noticed that many news sites that are owned by the same company will use the same UI to serve news articles. On /9RYyv archive the privacy policy didn't load.

匿名

yes

4 年前

/wfEQ8 can you please remove the pop-ups? /jOQZi /yAMjC /ItOLT /u3Sxq /JlRPo /3qHx7 /zXo5l /Of9kx the layout of the archived pages look disarranged compared to the original website and the article titles got hidden, please help fix. Just realized this particular website always has this issue when archiving. Thanks! :)

匿名

yes, fixed.

There have been to many “please, expand folded section“ on various websites that I started expanding them by default. Here is false positive, where folded section should not be expanded

4 年前

archive ph occasionally serves an invalid certificate (digicert instead of lets encrypt)

匿名

digicert is not mine

https://crt.sh/?q=archive.ph

4 年前

Could you accept all cookies on Z4drG ?

匿名

yes (it was not because of cookie modal, just miscalculated height)

4 年前

Could you click X to close the subscription window on M1Kig?

匿名

yes

4 年前

is it possible for you to expand the messages on /hHLcG?

匿名

yes

4 年前

Parlez-vous français ? Parce que j'ai remarqué que vous site Internet vient de France, au moins les serveurs de celui-ci. Si oui, le Nord-Pas-de-Calais est-il un bon endroit ?

匿名

French datacenter is already gone:. https://www.google.com/search?q=ovh+fire&tbm=isch

4 年前

Are the Archive-Today going to have the same search features as the Wayback Machine of The Internet Archive has, such as search by date and sitemap?

匿名

Maybe.

Even full-text search is planned, but there are too many current tasks :(

Hello, I was thinking about existential threats to your project and was thinking that a big lawsuit could threaten the project. Could you consider making a crowdfund page for your legal defense if you ever do have a lawsuit? I think hundreds of people would come to your defense.

gfair

I don’t think it matters unless your goal is to scam people.

Sci-Hub lost in court, and that only caused some domains to stop working, something that is a routine factor anyway, even without any courts or other malefactors (for example, right now I’m losing a domain - not one of archive.* but related - that has been stuck in transfer between two registrars for so long that it has expired meantime without letting me renew it).

Could you press "Rozwiń odpowiedzi" and then "Zobacz więcej odpowiedzi" on zGXLY to expand all the comments?

匿名

yes

4 年前

Thanks for the great service! I would like to ask to remove the email subscription box on /Cr1JK. Big cheers.

匿名

yes

4 年前

/kVFch The layout of the archived page looks disarranged compared to the original website. Is there a way to fix? If not, that's okay, but curious and want to ask. Thanks!!!! :) PS: Just wanna say thanks. I've been using this website a lot and occasionally donated.

匿名

yes

4 年前

Hi there, please help to remove the email subscription and red overlay on /pzf8r. Many thanks!

匿名

yes

4 年前

Could you press "VŠETKY KOMENTÁRE" on Wogpq to expand all the comments?

匿名

yes

4 年前

Hi there, hoping that you can help to correct an issue noted on some pages from a website where the side menu appears to activate in the archived page. Examples: /fzM7I /0pW5A /Gd04F /mcd3a. Is it possible to update a fix for all pages? Many thanks for your help.

匿名

yes

4 年前

Could you press jp text "はい / いいえ" (bgm on/off option) for expand /8cXKM page? Thank you.

匿名

yes

4 年前

Hello, what platform do you use for this Q&A platform? It looks quite well designed.

匿名

Tumblr

4 年前

please close the ad popup on /titMv /pFIwr .Thanks

匿名

yes

4 年前

Could you press "続きを読む" on them? BY8h5 8a9PX J1Hjh wam5U xc16B L61kF YVGxl 4rIFa QS7v9 PxJq6 6PLKU YbKA0

匿名

yes

4 年前

Do you have anything prepared for the fate of the archive in the event of your death?

匿名

It is an overly optimistic assumption that there will be no risks before I die. Many projects (including at least two in this area: peeep.us and webcitation.org) stopped working long before the death of the people behind them. Many projects pivoted following the money. In addition, there are many critical points (e.g., domains) that I have no control over.

Can you please click on "Nu niet, misschien later" at q3jvT?

匿名

yes

4 年前

Could you remove the pop-up at Vki6L ?

匿名

yes

4 年前

Can you please remove the cookie box on uMPea. Thank you.

匿名

yes

4 年前

Could you fix them ? /y2tOo /butqq

匿名

No. I see the same blank pages.

4 年前

LinkedIn profile archiving has not been working for longer than usual, can this get fixed, normally if it stops working it gets fixed after a few days

匿名

It requires premium (paid) accounts.

Regular ones have very low limits - they are logged out after several profile views and banned after several log-outs. A phone number is required to create a new account.

In other words, it’s too expensive for me. There are paid Linkedin scrapers, try them.

4 年前

why using storage to save screenshot of a webpage and only the top of the webpage, not the ful webpage ? Isnt possible to generate screen shot from saved webpage when user click on the screenshot link to save storage ?

匿名

It is possible but senseless.

You can make a full-length screenshot from saved page on your local computer or using any online screenshoter. (Adding /embed will remove the header, for example http://archive.is/MtiI6/embed)

The screenshots saved by archive are generated from the original pages, not from saved ones and can be used for debugging (catching differences in screenshots-from-original and screenshot-from-saved) and also for page preview in messengers. Full-length is not needed there.

In /vonz/#selection-181.1-989.21 all those links fails because there is a * in the url. Some of them were already archived (I archived myself). Now the reCaptcha is in a loop and I can't see them. Could be fixed? Thanks :)

匿名

They do not fail.

* has its magic meaning only at the and position, it must be ok inside urls.

4 年前

is there a way to archive a discord post when the discord server has an open invite?

匿名

Maybe. I am not familiar with discord

4 年前

I was wondering what do you use to "fix" pages. XPath?

匿名

sort of

4 年前

is it possible to expand the "Read More" for /9xYai ?

匿名

yes

4 年前

Could you please unfold/open all 17 questions on /kh2a7 at the bottom of the page? Thanks!

匿名

yes

4 年前

Could you accept cookies at jq2mo ?

匿名

yes

4 年前

Could you accept cookies on gimeB ?

匿名

yes

4 年前

Could you press "記事を読む" on these archives? ejgiM H7IZS 3hGh6 8NIpV VHv6G wlINT

匿名

yes

4 年前

Could you fix Dxh0m?

匿名

yes

4 年前

/vBMRy has a pop-up, is it possible to remove from this page? Thanks!

匿名

yes

4 年前

please close the ad popups on BitChute! /Mp9Kz

匿名

yes

4 年前

pi1mI has split into two columns for some reason. Can it be fixed? Thank you :)

匿名

yes

4 年前

TFyDq -- is it possible to hide the "Follow the Artist" popup (obscuring the 2nd image)? Also I'm not sure why the text looks so much paler than it is on the live page, or if anything can be done about it?? Many thanks.

匿名

yes

4 年前

I am trying to archive new things and it is appearing "Server Error", why is it happening? I have realized the archive is having problem for two days already, is the archive alright or is something happening?

匿名

It’s just a performance issue. I have applied some optimizations and hope this helps

4 年前

Hi there, please help to remove the Cookies box on /6LGmj. Many thanks!

匿名

yes

4 年前

what's going on for the format for reddit page /vI4WE?

匿名

One glitch, the CSS didn’t load. I rearchived

4 年前

Similar to Discus, some sites have comments at the bottom managed by a company called OpenWeb. /3yl7h for example. Are you able to click on the "see more" expanders and the "show more comments" whenever these show up?

匿名

Yes. I reloaded with 3yl7h with all the comments expanded, and it will soon be the default if OpenWeb is detected on the page

4 年前

just realized that I can search for keywords in the search bar for archive today, was this a recently added feature?

匿名

it has been that way from the beginning.But it works through Google and Yandex, so it can only search on pages indexed by them. Their bots are not very active in recent years, the archive is growing faster than they index. They are also removing old pages from the index. So this search function is in decline.

4 年前

"archivecaslytosk.onion" is invalid now (using Tor Browser 11.0.4), but the domain can be found at the top-left corner and the /share page of the archives on "archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion". Can you change them to "archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion"?

匿名

archivecaslytosk.onion works for me

4 年前

Can you expand spoilers on these two websites like /29REU and /z99gS? Thank you.

匿名

yes

4 年前

On many sites the comments at the bottom are managed by a company called discus. /A6zpl for example. Are you able to click on the "load more comments" link whenever these show up? Thank you in advance

匿名

yes.

4 年前

Please complete the captcha for /ChLHj it might turn out really important in the following months!

匿名

yes

4 年前

Could you click "Expand full comment" on Substack? For example, 5zLwW. Thanks!

匿名

yes

4 年前

How was last year's (2021) donations compared with 2020?

gfair

Almost the same, no grow no decline.

Below is Stripe’s chart (the payments via LiberaPay) and about the same amounts with PayPal, there are no charts.

Same mykyivregion website /zi6xO can't save that page on both your website and web archive. web archive saves the page but it is just "Error 1020 Access denied" page. I sent an error report to them but color me impressed. Are they just protected now from saving their pages from both of you? Can something be done with that?

匿名

I see “Error 1020“ from all my locations: servers, laptops, mobile.

http://archive.is/zvWot might be a workaround but it loses the layout :(

4 年前

Hello. Can you click see more in foodtribe com and drivetribe sites please. Expand in other words. Example rhi9O

匿名

yes

4 年前

Any possibility to display the article as already "expanded" at zApRm (and, for that matter, on every archived page from the niigata-nippo co jp domain)?

匿名

yes

4 年前

The queue system is kinda strange, if aready there are some people in queue sometimes your snapshot will be created even if the queue didn't finish!

匿名

Many items in the queue are sent by bots. They have a lower priority.

4 年前

Is there anyway you can present to the user what site was archived? For example /zi6xO shows the default error but doesn't present any additional details like when it was attempted or what site was attempted to archive.

匿名

Usually the error pages are stored too.

There is one exception: if there is a chance to mitigate the error my retrying using another exit IP (like in zi6xO case: https://imgur.com/pNoffVY.png), it is not stored. And if the archiving gives up after 10 retries it is not stored at all. I agree that it is confusing and one of the error pages should be stored anyway.

4 年前

Could you expand dwGc8 ?

匿名

yes

4 年前

/jWcsj and /0I5nQ are having issues, but /84t2P does not have an issue. I'm trying to record the covid numbers presented by the US government to its people. Could you take a look at it?

gfair

I increased timeout for this website. It helps the digits to load, but the country map is still blank :(

4 年前

Can't save zi6xO for some reason. It is just a normal page. Is there something wrong with it? It's interview with a local corrupted politician on a website were you should pay to be interviewed, they can take some measures against saving, but I would be surprised, they're not that sophisticated usually

匿名

they show cloudflare’s “access denied” to us.
web.archive.org does work

4 年前

can I use archive today for a google site

匿名

what does it mean?

4 年前

used to be able to capture linkedin profiles. now it archives a log-in page. any way to change this?

匿名

They are banning my accounts, they don’t seem to be happy with you scraping. New accounts require fresh phone numbers, so I can’t register too many.

I’ve seen paid linkedin scraping services, better use them. Unlike me, they should be motivated to buy new sim cards and register accounts.

There have been ~400 linkedin captures in an hour. How many accounts must be there to pretend a human activity? For a free service, this is far from budget-friendly.

4 年前

I see you've said no to opensourcing... 1. would you be open to a paid api? 2. is there a fix planned for downloading the archive in zip?

匿名

1. there are already few open-source (at least ArchiveBox) and few paid-api (at least Stillio) alternatives. I see no reason to follow those ways just because they have been done already by someone else - it would be useless waste of time.

2. yes, but I am not sure when.

Is it possible to fix the error numbers at avfKD ? Thanks in advance!

匿名

No, it is what their server shows. At least to me.

4 年前

When I use the onion link for archivetoday, and you use the search bar for a website. It redirects you back to the regular clearnet site, instead of still using the onion domain. Can you fix that please?

匿名

yes

4 年前

Could you please remove popup from /o5pM8 ? Thanks!

匿名

yes

4 年前

Can you please remove the cookie popup at BWL9b ? Thanks in advance.

匿名

yes

4 年前

Please click "このまま、以前のほぼ日手帳のページを見る" at hEPzq

匿名

yes

4 年前

Could you please remove the cookie box from /NsvPC ..? Thanks!

匿名

yes

4 年前

hi all the figures from HetXC are missing. can u add them back?

匿名

yes

4 年前

for /02pyJ, may you click "see all" for different profile sections?

匿名

No, “see all” buttons lead to other pages. You need to save them separately

4 年前

How long do i need to wait to retake a new snapshot for same url?

匿名

Usually 5 minutes, there are few exception for quickly changing social websites like Reddit

4 年前

Could you scroll down for S8yfK ?

匿名

No. Facebook bans for robot-like bahaviour (like “open a page, scroll down, close” cycle used for many pages), so it is better to capture the top of the page than nothing at all

4 年前

Can't access archive_today or ph is fo vn... domains are resolved to 85_143_223_176 (simplecloud_ru), tracert reaches 85-143-254-218_customer_comfortel_pro and get redirected to 192_168_240_132. Is this site hosted in Russia? I used some online tracert tools and some of them reported packet loss. Tried access the site via US proxies to finish archiving, some didn't work (Dallas, IL), but one has worked. Recently I had similar issues with routing to archive_ph, they come and go. Just reporting...

匿名

That IP is no longer ours (someone uploaded child porn and immediately reported it to the owner of the IP block, so the IP was lost - the routine lifecycle of a website where anyone can upload anything).

Please expand "See all 7 experiences" on /qAgJ0

匿名

No, clicking there doesn’t expand it, it leads to another page

4 年前

mxV3V and others from this domain seem to be region locked.

匿名

fixed

4 年前

Have you thought about selling NFTs of the archived webpages to raise money

匿名

no

can comments be expanded on IemTB please? thank you

匿名

yes

4 年前

I've been getting malicious redirects on archived Reddit pages today, is everything OK?

匿名

Could you tell more?

Where do they redirect you?

There maybe something in the ad banner code

4 年前

Can you click Continue on 4QoRA cSXSM g3BVy

匿名

yes, done.

Future saves from that website should click automatically

4 年前

How much money would it take to build a foundation to protect your project past your retirement?

gfair

I am not good at turning money into something useful

4 年前

About Reddit logged out view: Reddit plans to change the block feature so posts and comments will be hidden if someone blocks your user. A logged out view might be useful there. However, I think this situation will be rare, so logged in snapshots may still be better as the default due to the advantage of seeing mod lists.

匿名

It seems that the best to avoid such blocks would be to have 2+ accounts and retry in case of receiving a block page. Let me know if you spot a block page, I will add more accounts.

4 年前

Hello! I've appreciated your services for a couple of years now. (Enough such that I finally hit the donate button a few weeks ago.) Today, I noticed that the sites are not coming up in either my Chrome or Brave browsers, but do come up in Firefox and Mozilla developer browsers. Something inadvertent or a possible deliberate config change?

匿名

Likely a DNS or state firewall thing

4 年前

Hey, do you have a Bitcoin Cash (BCH) donation address? I have been using your site a lot and would like to thank you for it.

匿名

No

4 年前

Reddit pages currently have a logged in view. Can there be a way to also allow a logged out view, maybe on a specific subdomain like un. reddit. com?

匿名

Is there a case when logged out snapshots are better than logged in?

Logging in is rarely required for Reddit, so it might have sense to use logged out by default if it has any advantages

Please expand "Henry Parrott" on /yzwlJ

匿名

yes

4 年前

What would be needed to give /fV2te a more accurate archive? Is it a html canvas thing?

匿名

It is a custom implementation of scroller (there was another report about the same thing on adobe.com). There is no single long page but a virtual space which reorders its subelements depending on the current scroll position. It is difficult to make a single long page out of that.

4 年前

full page for /IOOOy not saving properly

匿名

yes

4 年前

On /jXbOD, may you click on "see more" for more details on profile itself, also applies to other profiles saved previously

匿名

yes

4 年前

cLX91 - any chance of getting the 12 missing images to show? Many thanks if you can :)

匿名

yes

4 年前

2021-12-20 Is the Archive.* going down or suffering a temporary outage?

匿名

No. Although there are fewer visitors today than usual. There might be some problems with regional connectivity.

4 年前

I've been having difficulty with the page-saving function. Sometimes it works, other times it doesn't. What website I'm trying to archive seems to have no bearing on what happens. Please fix this or I may have to use another service.

匿名

There is no enough information to locate your problem, so the latter seems to be the easiest solution.

4 年前

Can you please remove the popup from 7hCXO ? Thanks in advance.

匿名

yes

4 年前

/u33aL and /adU36 have a pop-up window. is possible to remove for these pages? Thank you!

匿名

yes

4 年前

Hi. Does clicking on the archived page change anything? For example, if I click on "like" or "retweet" on an archived Twitter page, does the archived retweet/like number change?

匿名

No, the values are stored at the time when snapshot is taken and do not change.

4 年前

Is the infinite captcha loop really necessary? It's fucking irritating.

匿名

Can you provide additional information for the investigation? Time, the page you are going to, the IP (or at least the country). There are no user accounts there, so it’s hard to identify your problem starting with the report.

4 年前

Does the Archive have any form of tracking who is archiving what? If yes, does the archive sell users' data since there are adds on the Archive?

匿名

For me, too, it’s merely a surreal media reality from the other side of the globe, where Zuckerbrins walk upside down, play golf and trade user data for billions. I don’t believe I have any data that anyone is interested in buying.

Can I do a one time donation without creating an account on some weird service?

匿名

yes.

the donate button on the main page goes directly to paypal

https://www.paypal.com/donate?hosted_button_id=JK2ECW9A9SMMS

4 年前

Please remove alert and shading from Outkick (hOeRS)

匿名

yes

4 年前

xpPuB Please remve popup

匿名

yes

4 年前

Please remove box & shade from /Odzrx

匿名

yes

4 年前

Could you remove pop-up on /OVDDt /oMfL0 /8WDFO and /Ydiuw ? Please and thank you.

匿名

yes

4 年前

Did something change with Google Docs? Text isn't able to be highlighted as it was a year ago.

匿名

example?

4 年前

Can you please press the "Akkoord" button OhRC4 ?

匿名

yes

4 年前

Can you accept the terms and conditions of pages like qvJuk please?

匿名

yes

4 年前

Hi, according to support DOT torproject DOT org/onionservices/v2-deprecation v2 onion are no longer supported after Oct 2021. Can you please all reference to archivecaslytosk.onion in your v3 oinon site archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion ?

匿名

I don’t know what exactly is meant by “support” here, but we are now after October 2021 and v2 works fine. Probably something to do with the type of support I’ve never used.

4 年前

Pls remove the "Warning" boxes displayed on usfinf (.) net, for example amORl, k592D, IEaqB, r5328, mSKZF, jKLXA, Fdska, PWNvs, duNTq, zZ9gH. It would be even better if you can just click "skip ad" button right away and redirect to the real page, so no ads will be saved on your site.

匿名

Why don’t you submit directly the target url (on mediafire.com) ? If someone submits the url of the interstitial page, that is understood as request to archive the interstitial page.

4 年前

why did you remove /Pd50p (some weird song about russian war), what's the point of all that if you comply for such dumb gag order, weren't you switching to new domains when you were getting blocked in the past ? thank you for your work anyway

匿名

I think it is temporary. That page was unavailable for Russian visitors, but their authority blocked the whole domain (the last one, btw) because they were still able to see it, likely due to some GeoIP databases mismatch. World-wide block of that page is merely for debugging.

Anyway, you can see it on .onion if you need.

Can you please remove the orange mask dialog in tBIrI? Links behind that dialog are not accessible.

匿名

yes

4 年前

Hi, in /eR6OF there is a pop-up box about cookies. Can it be removed?

匿名

yes

4 年前

For /DlNyp, may you save another snapshot of the page, but after clicking the "agree" button?

匿名

yes

4 年前

When the number of snapshots of a certain domain reaches 9999 and then more snapshots are made, are the older snapshots deleted or are they still saved?

匿名

They are still saved. It is just difficult to search for them.

Does the archive-is has a limit of saved urls? Because I've done a * search on certain domain and it is stuck on 2997 and then I realized the old saved urls are "disappearing", are they really being deleted or are they still there? If so, how is it possible to access the urls beyond the 2997-3000 limit while searching with *?

匿名

They are still there. The search function needs to improved, yes. Currently, there are performance issues to return more results.

4 年前

Are the archives permanent? As in if the main site went down would the archive snapshots remain?

匿名

Yes.

This is the main feature

4 年前

Could you remove popups from AliPaczka? Thanks in advance!

匿名

yes

4 年前

The image in /OyquX isnt showing up for me. Can you check if you can get the pic to be visible?

匿名

it works, just hit refresh

4 年前

Could you expand /Bni6Y /0gHzZ button?

匿名

yes

4 年前

Can you make archive save links hidden in "accordion" sections of web pages please? I am referring to the content that gets revealed when hitting the "v" icon button on some pages. If expanded it shows content that I need. Thank you

匿名

It needs hacks for each website. Please report each not-working accordion as a bug.

4 年前

Hi there, there is a pop-up box for accepting cookies on 9WaF5. Is it possible to remove? Please and thank you.

匿名

yes

4 年前

Hi there, please kindly help to remove the pop-up box that shows up on s4kS7. Many thanks!

匿名

yes

4 年前

FYCi7 and q7uFm have a pop-up box at the very bottom. For FYCi7, it covers some of the text. Is it possible to disable or suppress this box from all similar pages? Big thanks.

匿名

yes

4 年前

Popups issue with /9Df6X and cookie box /wpy5u - Thank you.

匿名

yes, fixed

4 年前

Could you press the view button at /PpNdv?

匿名

yes

4 年前

Can you please remove cookie popups on StackOverflow or StackExchange archivals like sd9Nn ?

匿名

yes

4 年前

Do something with a CAPTCHA loops, please. I'm not a fucking robot!

匿名

It has very little to do with distinguishing between humans and robots. it’s just that if the backend can’t handle the load, if there’s an hour-long queue, the captcha gets madder to keep only the most motivated and chase the rest away.

4 年前

Twitter decided to use the new layout... I want the old layout back!

匿名

Ask Twitter

4 年前

Is there a way to capture page without redirection? For example lets say there is page in one language and when I save it redirect it to another language so the actual page I want save can't be saved.

匿名

That’s site specific. What website are you talking about?

4 年前

Could you press the expand button at e2o5s ? Thank you!

匿名

yes

4 年前

Can you remove the popup on /O3haH ?

匿名

yes

4 年前

Can you record LinkedIn profile?

匿名

Mostly, yes. Archiving pages that require logins works unreliably: accounts get banned, sites sometimes show captcha or prompt to confirm new terms, etc

4 年前

Thank you for the project; one question about the X-Forwarded-For header: is that only sent the first time a page is archived? Or is it also sent on subsequent views of the archived page? Thanks

匿名

It was in PhantomJS-based archiver, which worked until December 2019.

4 年前

Hello~ there is still a subscriber banner blocking the article on /E87xn would you be able to remove it?

匿名

It won’t help: there is no text behind the banner.

4 年前

Archive isn't fully archiving imgur albums like it used to; can't "load more" /CWWul as an example

匿名

yes (I know, it is the second time; sorry for the delay)

4 年前

Can you expand comments here? /MITkp

匿名

yes

4 年前

Could you fix VqJuI and U6eXg as well as the rest of failures from Allegro (online shopping service similar to eBay and AliExpress)?

匿名

yes

4 年前

Can you remove the popup in /tabBh? Thanks

匿名

yes

4 年前

Can you remove the ytb popup from 4rmc1 please?

匿名

yes

4 年前

I keep getting "Not found yet?" for some of my archive attempts Example 1: /Pxle8 and 2: /cABOV

匿名

yes, the archiver gave up after 10 retries. There is something wrong with quora archiving last days. I will investigate

4 年前

Can you delete the feedback button on /oxRUc?

匿名

why? it does not interfere with the reading of the page

4 年前

Can you expand on vimeo descriptions please. 2Hspm as an example

匿名

yes

4 年前

Can you please remove the cookie box on eAqcq, f4h46, UaoQx, tbGl8 and VWZNz. Thank you

匿名

yes

4 年前

Please expand the show more in 9olXh

匿名

yes

4 年前

Can you check UqqLw and 1I3Qn, the archived pages show large section of blanks?

匿名

yes

4 年前

Could you expand the video description and the comments on Odysee com videos?

匿名

yes (will be active in 1-2 hours)

4 年前

please expand replies to comments on Minds /BLwXM

匿名

yes

4 年前

Indiegogo website isn't saving properly, can you take a look?

匿名

yes, fixed

4 年前

Hi, Where is this archive page please - BMJ rapid responce that was removed. Th0TK ? Thanks

匿名

It was not removed, Th0TK is not a valid id (converted to the numeric form, it is much bigger than the current id).

4 年前

What Adblocker are you using?

匿名

It can be said that it is custom. One still has to interfere with the browser’s network requests and patch DOM to archive pages. Ad blocking is just a small part of that.

Please, remove that cookies line across the screen: JI8JG

匿名

yes

4 年前

Can you remove the blocking of content in /gKIrd? Thanks

匿名

yes

4 年前

Sometimes the archiving process gets into an infinite loop before eventually giving up. Can you help to look into this one? Many thanks: /wip/rgkTe

匿名

Fixed. There was no reason to give up

4 年前

Can you recapture /9NaId so it loads the full article content? It only has the first 3 paragraphs.

匿名

Yes fixed. A collision with adblocker.

4 年前

Please expand the article and comment section in /lPUAS ? Thank you!

匿名

yes

4 年前

The "search this url in WebCite" link displayed on the search results page is corrupted and always says "DB Connection failed" Can archive_today fix this link?

teruteru128

The link is ok, just WebCite is often down

4 年前

Why can't we archive an instagram account?

匿名

They banned my account again.

Can you donate a verified/trusted account ?

Can you try to get the shirt image working on IeGCR ?

匿名

yes. Thank you for reporting - there was an issue with Stripe’s browser fingerprinter, so there might be many affected websites.

4 年前

Can you remove the popup on /0JI7x ? Thank you

匿名

yes

4 年前

Strange result of LJ archiving -- no main publication (post), no comments: ph/0xDaf

匿名

yes, there is a regression after removal “auth error“ on ivanov-petrov. it will be fixed in few hours.

when im trying to archive from facebook, why its just show Loading ???

匿名

Facebook redirects to /login.php and the archiver tries again and again.

Creating accounts (which works well for many websites) is not an option for Facebook - they ban the accounts very quickly, even those which were not used by archiver but just accessed using the same IP addresses.

If you have and can share credentials to one of those 5 million privileged accounts or another idea on how to browse 5-10 Facebook pages per hour - let me know.

4 年前

Can you please press "Accept and close" at these pages? → JaMig ZgYH2 B1Hoq m7Iam Y8uUp G6wEg CVSBu dXSOT r7V6C rn0ah f4Yjn Zon8h Io4SP 2O6eI ZG7cD xYsLT sCFUN a9Hey

匿名

yes, fixed locally, will be available on next deploy (in few hours)

4 年前

Good day. Url archive_md don't works a few days, via proxy and anonymizer - too.

匿名

Maybe because of

https://reestr.rublacklist.net/search/1?q=archive.md

4 年前

Why does archive,today (redirect to archive,ph) lead to a 403 error, but archive,is works just fine (redirect to archive,md)? This is breaking the Chrome extension. (I replaced the dots with commas)

匿名

I do not see 403 error

4 年前

Is linkedin archival not working?

匿名

It is unstable. LinkedIn often logs out asking captcha to relogin, and sometimes bans accounts. Not so badly as with Facebook. LinkedIn mostly works.

4 年前

I like your service. Is there another way to help this service without having to donate?

匿名

Reporting bugs, there are a lot of them

4 年前

Could you add "Redirected from" and "Original" to google cache and bing cache archives like yandex cache archives?

匿名

Please give examples. It supposes to work with all those caches, but sometimes fails, as they change design

4 年前

How much revenue are you generating from the ads being displayed on the saved pages?

匿名

The last few days are not bad - it almost covers expenses. Perhaps a generous advertiser has arrived.

4 年前

is there an ios app that lets you browse the archived pages and archive urls? if not you should make one

匿名

No

4 年前

What are some other archiving services other than this and Wayb?

匿名

freezepage, etched, webcite, megalodon, ..

I do not know them all

Is archive Free Software? What licence is it? Where can we download it? How can we run our own instance? Do the various instances inform each other of the content they are archiving?

匿名

No

4 年前

Can you pleas fix the "Accepteer alle cookies" popup in C8Ttl ?

匿名

yes

4 年前

Hi, I love your service. I would like to ask, do you know of a way i can automaticly redirect shitty articles to your archived version? for instance, news, articles, tabloids, evil stuff. I would be doing because your service is a lot easier on my internet connection. next, and last question - how do you fund all this? Thanks!

匿名

I recall there was something in GamerGate times, but I forgot what it was. A browser extension? People did not want to visit websites of the opposite party and used archive as a proxy.

4 年前

Hey man. You may remember me from the 9gag request. I just humbly ask if your archiver can recursively access comments and expound more on other 9gag archives? The gifs are not playing. The "hidden comments" also are not seen. And it just captures one layer of the replies. The 3-5 first top comments also do not show replies. Only from the 6th beyond shows it. Please expand more on this.

匿名

“Expand” is clicked, but yes, sometimes it does work (for example the latest http://archive.is/kUKIq has all but one comment thread expanded). Perhaps I click too fast or too slow, it needs some tuning.

4 年前

Can you please remove the "Let's Get In Touch messenger" pop-up at /RjUOh? Thanks so much! :)

匿名

yes, the popup will disappear on the next deploy in few hours

4 年前

It seems: wip/12LNt will not complete the challenge. Can you have a look? Thanks, great service.

匿名

It gets stuck in https://imgur.com/KMYY1P3.png

I cannot see the page too.

4 年前

Hello. The website lajornadafilipina (.) com has "Adblock Detected" pop ups in your archive. Can you fix all of these links and archived pages? Remove them please. Thank you

匿名

yes

4 年前

Can you remove the "I Understand" popup at 0Rv1R ?

匿名

yes

4 年前

Can you remove the "Subscribe now" popup from nBJJg please?

匿名

yes

4 年前

Hello. Does this archive work with Flash?

匿名

no

4 年前

Why has 'is' been redirecting to 'vn' and 'md' today? Should we start switching over, or is this a temporary thing?

匿名

There is again a tension with .is registry about the screenshots with bitcoin scam evidence, they threaten something using poker vocabulary so I didn’t really understand them. So for now I put a redirect.

https://twitter.com/archiveis/status/1450140729209200643

4 年前

What happened to all those meme donations you got? GhostArchive mentioned that they might be fraud. I'm sure I'm not the only one worried about the project

gfair

no refunds so far.

554 may be related to “angel number“?

4 年前

Why do you view FB, IG, TikTok, Snapchat as "not-Internet", comparing to Reddit, LiveJournal and VK?

匿名

This is a subjective perception. For me they are closer to Second Life or Dota2 than to Internet sites. Apps first. Member-only. Upsells. Websites are difficult to use, they are just as reserve mean of communication.

Archiving Facebook is not working. Could you fix this?

匿名

No

4 年前

can you expand the log, info and comments on /GgHiM and press "Show Details?"/"View Strife!" in /VKncs

匿名

yes

4 年前

Popup issue with 2ijnL - Thank you.

匿名

yes

4 年前

archived yandex translate pages have a "enable dark mode" popup that is blocking part of its pages

ex: /2sIpr

thx

匿名

yes

4 年前

Can you make the block in /vbRmh go away please? thanks in advance.

匿名

yes

4 年前

What is this flash mob with dozens of donations at 5.54 euros each?

People have pointed me to your posts so I guess I will clarify a few things. 1. Yes, unauthenticated API endpoints do exist, but they are as IP-metered as scraping the website. The ratelimit is not constant, and "high-limit" IPs are very scarce. 2. DON'T think about logging in. If they identify you(r account), whatever happened to people like me will happen to you. They hate good causes. 3. There's no "drama". Finally, as the developer of Barinsta, thank you for your support!

匿名

So, basically, the only solution is to use more proxies.

And the obstacle is I am not ready to pay for proxies to solve issue with FB/IG ($100/mo, +5% to overall expenses, but still), although I would do that in case of Reddit, LiveJournal or even VK. It is a subjective view on FB, IG, TikTok, Snapchat, … as not-Internet.

C&D letters are not a problem, I hope we could withstand them. There was one from FB few years ago about a page with leaked phone numbers of their tops, it is still online.

4 年前

9gag posts are not archived very well. Please make it accessible. Example archive. is/08tJN . Only 3 comments are there. It should archive all comments of the post, similar to reddit. Thank you

匿名

yes

4 年前

Which archivetoday mirror should I use? Which one is expected to last longer?

匿名

archive.today. It has no content, just redirect to a live mirror, so it is expected to last longer.

4 年前

What technology is used to save the webpages?

匿名

Chromium

4 年前

A page I archived has popups on top. I thought this was not supposed to happen?

匿名

Yes.

But the algorithm that kills popups is not perfect.

Please report such pages to help it learn.

4 年前

Why is it that you removed the ability to archive a webpage more than once? The "already archived" message doesn't show up anymore on pages with already existing snapshots.

匿名

it is a bug, it should be fixed in few minutes.

4 年前

Please include mirovich DOT media as LiveJournal-handled site internally (expanding comments).

匿名

yes

4 年前

Please press "Read More" on akfXp, 4DYyR and also other pages archived from www-mywot-com to unfold the comments

匿名

yes

4 年前

Can you press the button "Show full description" on Qzzeh and other saved pages from the same website?

匿名

yes

4 年前

Can you show all of the images on jTWM6?

匿名

yes

4 年前

Could you fix this news source to remove the nag screen on the articles? /OQxk7

匿名

yes

4 年前

Can you get the archiver to consent to this interstitial? /ZtX89 Thank you so much for all that you do

gfair

yes

4 年前

How do I search old questions in the blog?

匿名

The blog is on Tumblr, and I am not familiar with its features. The first idea is to use an external search engine and add “site:blog.archive.today” to the query

It looks like I cannot save the URL twice in a row?

匿名

There is a timeout to avoid races when many people are trying to save the same news page: everybody sees that there is no snapshot yet and archive the page. In few minutes there are 100 snapshots.

4 年前

Are you paying ~$2200 out of your own pocket every month to keep this site running?

匿名

yes

Can you please remove the cookie banner on u57H5 ?

匿名

yes

4 年前

Is there a way to see the IP address a server was at in a historical snapshot?

匿名

yes, but not easy

4 年前

Pages from National Review Online don't seem archive at all. The archiving process will try to save the page multiple times, but it never finishes. Eventually it just times-out. This has been an ongoing problem with this website specifically. Is there any way to fix this?

匿名

yes, fixed

4 年前

How to archive a public facebook page

匿名

I don’t know.

If you find a cheap method (without buying residential proxies and/or hacked accounts on dark markets), let me know.

4 年前

Is it ok to embed archive links in a commercial product?

匿名

Hm, am I in a position to allow or prohibit this? Would, for example, Facebook (just an example of a commercial project) comply if I prohibited them from embedding links to the archive?

Please expand all on JsGWI.

匿名

it expands on click as the original page.

4 年前

Can you expand responses at 0TEpJ

匿名

yes

4 年前

Did you stop using Edge? (Is it just Chrome now?)

匿名

There was no Edge, it is just spoofed User-Agent string.

4 年前

The South China Morning Post archive link in /0mgVP has a popup that obscures the text. Can you close the popup before archiving? Thank you.

匿名

yes

4 年前

Can you make the sensitive content block in /LwbVD and /yHwIX go away? Thanks in advance.

匿名

yes

4 年前

It looks like archiving kickstarter pages times out. Is this a persistent issue, or just a temporary thing?

匿名

Kickstarter shows captcha to the archiver, so it retries until gives up. Here is your page: http://archive.is/KGsE3

4 年前

Archival for documentingreality doesn't seem to work anymore, though it did in the past. It always returns "Not archived (Yet?)"

匿名

documentingreality mostly does not work.

Hello, I've used your archiving services few years back and I remember your log and archiver IP logging policies changing over time. May I ask when (around what year and month) you have implemented the "archiver IP gets included into the snapshot indefinitely" policy? Thanks

匿名

There are no such policies to enforce. IP is saved to fight spam, not as a result of some ideology.

4 年前

Is archive[.]closed[.]social yours?

匿名

no

4 年前

Would you mind fixing 'yMvH4' and 'pHhGb'? Sputnik International only recently started to archive incorrectly; before, there were no problems. It must be caused by their new page layout. Thanks in advance for fixing it.

匿名

yes

4 年前

Can you make StackOverflow/ServerFault/StackExchange/etc expand the "Show X more comments" for both questions and answers? Thank you! Sample one here: archive/CU6dx Also, any chance to fix their width in their new design? The questions and answers are too narrow, especially if there's any code involved. It appears that they have a cut-off width in CSS to get rid of the right column, and archive must be just slightly above the cutoff.

匿名

yes, added comment unfolding (example http://archive.is/wYEAK).

I am not sure about fixing the narrow column, there is useful info aside, job offer, etc.

4 年前

Have you considered asking archive org to host archive is? You should look into getting support from archive org so you don't have to pay for this all by yourself.

匿名

As far as I understands, archive.org’s financial are not better than our, just 100x bigger: Brewster Kahle has to match the user’s donation 3:1 from own money. You only get one basket of eggs instead of two, plus dependence on the volatility of American politics and cultural codes for page removals.

Would you mind sharing the details of what you patched in Chromium in the “remote debugger protocol”? My guess is that it has to do something with the CSS domain elements (I used that in the inling module I made) but it seems to be working relatively fine (still few issues) with no patches whatsoever. Even the anti devtools detection module I found (Cloudflare wait 5 seconds bypass) didn’t require any patches to Chrome itself.

ghostarchiving

There are mainly 2 things:

1. backward compatibility with versions of Chrome previously used, to make old DevTools protocol captures readable after upgrades

2. remove useless info from `DOMSnapshot.captureSnapshot` to make the answer smaller, and add useful: as for CSS, it includes what `getMatchedStylesForNode` would return for each node.

Anti-devTools pages are bypassed just by retrying using another exit IP :)

4 年前

See if you suddenly died and that hardware failure happened, the whole archive would never be accessible anymore and it would give a "Server Error" forever. Huge flaw in system redundancy.

匿名

For redundancy, try something like etched.page, they store pages on Bitcoin blockchain.

4 年前

Do you retain the contact and location information (I mean names, phone numbers, ip addresses, emails et cetera) of those who submit reports on captures? For how long? Is this information treated differently depending on if the report is processed or ignored?

匿名

Do you really think such statements make any sense? I don’t. There are two objections:

1. for the realists: the backend is usually a very messy piece of software, and no one is going to bother enforcing policies advertised somewhere on the site and syncing with them. There are too many contingency factors more affecting than any marketing statement on what is retained and what is lost today.

2. for the paranoid: how can you trust statements like this in the context of headlines like “ProtonMail removed the no IP tracking clause after eco-activist arrest”? If someone claims they don’t track, that means no more than they haven’t committed anything yet that would disprove their claim.

Currently, the “report form” sends its content via email to a dedicated Gmail mailbox via unencrypted SMTP, so assume that everyone knows about your report. Even if I would say there is high-grade encryption in a nuclear bunker, assume that in reality there are SMTP and Gmail

4 年前

Can you skip the disclaimer page on the godlikeproductions forum? Ex. /tsV3v Needs cookie 'disclaimer1' = 1

匿名

yes, a bit later (2-3 days), sorry, too busy days

4 年前

How much in donations per year would make the project significantly more comfortable/effective? In other words, what's your donation goal? (I have no idea how much it costs to run and how much you receive in donations.)

匿名

I prefer not to speak in terms of goals, and I am suspicious of those who use such wording. It’s good to talk positively here: what features can be implemented when achieving it, but this opens up space for negative connotations: what if the goal is not achieved? or was achieved once, and then the stream of donations dried up? will the project close? will it be aggressively monetized? will it be sold to chia miners?

4 年前

I archived a twitter URL about 4 months ago. Now it's been removed completely. Why is this? URL: twitter @ gnosticplayers

匿名

I did not remove. Maybe you archived to another website?

4 年前

when do you think the site will be able to archive instagram/facebook again (if ever)?

匿名

Instagram - very possible, as far as I know, there is a possibility to pull all the information through API, without having to constantly search for new accounts.
Facebook is more complicated

What are your thoughts regarding the discussion of your service: news. ycombinator. com/ item? id=28457655

匿名

This explains today’s record number of donations (five), despite the fact that the site was down most of the day.

What was/is the reason for the recent site outage, if you mind telling us?

ghostarchiving

Sorry, a hardware failure at an unfortunate time

4 年前

What percentage of 5-char-codes is used now? Full capacity is (10+26+26)^5 is above 900 millions, it is correct number?

匿名

A bit less than a half. Afterwards the codes will be 6-char, 7-char, …

4 年前

What is time zone that is displayed for snapshots? Thank you

匿名

UTC

4 年前

Is there a reason why there is so much traffic from Japan to this site?

匿名

Maybe because it has localized version (there are only three more or less good ones: Japanese, Korean and Polish), or just popularity in certain communities.

When archiving "wayback vefsafn is" the carrusel of dates appears at the beginning (in "web archive org" that doesn't happen). Example: pSP7g. Maybe it can be removed.

jakeukalane

yes

4 年前

Why is access blocked in /t77dr? Can you remove the block? Thanks in advance

匿名

yes

4 年前

Thanks for removing the pop-up window and display full content. Can you make the links within the archived page (especially "THIS REVIEW IS HELPFUL" and "Flag as inappropriate") still hoverable and clickable? See the original pages for details. ysKuG, UmDJf, 5esIa.

匿名

No, JavaScript is not stored. It’s hard to allow it to run correctly on snapshots.

Could you fix GameSpot GameFAQ archives? For example: P6r0D and 3mj5i

匿名

yes

4 年前

Could you incorporate as a charity so that people can make tax deductible donations to you?

匿名

In which country?

4 年前

Is there any structure in place to assure the continuity of this project? I have seen you answer to a similar question that you "can leave a will". I am genuinely concerned about the loss of data archived here, were you - God forbid - to be hit by a bus or something.

匿名

I had an email provided by my mobile operator. I considered it very reliable - even if it was hacked, I had a paper contract, I could visit their office to restore. So I used it in critical places: in contracts, as an email to register on all sorts of utility sites, as an email to restore access to various services. After 10+ years, the mobile operator decided it wasn’t their business and shut down the email service.

What structure in place could assure the continuity?

I’m not even asking if there was one in that case (and if there is one in GMail), I just don’t understand what could be such a structure to assure continuity of any service. What should I have demanded to avoid data loss?

Archive.Today was born precisely out of an understanding of the fragility of services from which it itself is not immune. And this is not a project to transmit information to distant descendants, it is a project to let latecomers be witnesses. Having the magic to assure continuity, I wouldn’t need to invent such weak tools.

What is your perspective on creating a new page for "trending" and "most popular" snapshots? Or is that something that can lead to disasters?

匿名

It can be used as a news stream (that’s where I get my news), but there’s a lot of garbage too. Also, trolls can promote disgusting pictures to the top.

If you run out of money, will Wayback Machine take over the backed up pages? It would suck if they all just disappeared. Big fan of service BTW

匿名

I can leave a will, but how can you be sure that they will be happy to receive it and that they will dispose of it in such a way that you will like it?

4 年前

Question - How the heck does this archive retrieve saved pages from many years ago so quickly? Is there some sort of CDN being used?

匿名

No, there is no special optimization, simply because copying large amounts (e.g. to CDN edges) would take weeks or months. But. It just so happens that older archives are now running on more powerful servers, and there are fewer requests for them than for newer ones. So I’m getting both complaints about the site being too slow and wondering how it works so fast at the same time :)

4 年前

Can the pop-up window be removed? Also can the 'Read More' buttons be clickable to expand the text content? ysKuG, UmDJf, 5esIa.

匿名

yes, fixed locally, the fix will be deployed in few hours

4 年前

If you ever get another Instagram/Facebook login credential, you may want to limit the number of exit IPs used by crawlers to just one, so that it looks less suspicious. That might be the reason why the accounts created in past might have gotten banned so quickly.

匿名

It is so since long time ago (and still so for Linkedin, DeviantArt, VK, OK, … and other sites which do eventually ban but are not so paranoid as FB last years).

There is multi-exit VPN using patched Wireguard, which control exit IPs for many websites (it is not only for accounts: many US local media need US IP, etc). This could be an interesting product itself: to avoid seeing “this website is not available in your region“, and yes, to protect accounts from being banned when you are traveling.

An analysis of recent bans of my accounts has convinced me that blocking occurs after visiting questionable pages in different languages from the same account. Apparently, FB algorithms believe that if a normal person reads fake news, then only in one language. Interest in such pages in different languages (from German to Marathi) can lead to the classification of the user as a data journalist or similar undesirable visitor who “do not follow community guidelines“ as they say

4 年前

If you find the time, could you please fix the body of text on 'EOZ73'? The older versions of The Washington Post seem to have this problem. Thank you kindly.

匿名

yes, it seems that WaPo has to be added to the list of slow websites which require pressing F5 after the load. There is more than one snapshot similar to this. I’ll fix it in a few hours (there is compilation is in progress).

Getting a 403 forbidden error when trying to visit the site, and Down for Everyone or Just Me says the site is down.

匿名

Meanwhile people are posting links on Reddit, Reddit is able to download preview images, etc: https://www.reddit.com/domain/archive.is/new/

Also, there are at least 2 services named “Down for Everyone or Just Me“, one in .com and another in .me, and they tell different things.

4 年前

Is there any word on when the site will be back up/why it went down?

匿名

it is not down

4 年前

For /V0IKY, may you make the crawler wait a bit longer before saving the page so the data being queried can show up? It currently shows the screen for when the information is still loading. Thanks in advance.

匿名

Yes. Actually, waiting a bit more does not help. Pressing F5 does.

4 年前

In 'Reviews' section of archived pages (A few examples: CKEMU, UsI2N, Q55Ti), 'Read More' buttons are unclickable. Can comments be expandable when clicked?

匿名

yes

4 年前

In an anonymous post yesterday, I asked, "I am interested in donating to support Archive Today but don't see any way to do that." I have not yet seen a response.

oneskywalker

there is a “donate” button on every page, so the question seemed like a joke

Could you fix the outlink redirect on tiktok? /HHlSN Thank you so much

gfair

yes

4 年前

Currently Archive is available at archivecaslytosk.onion/ Onion services v2 will be deprecated soon Please generate and publish v3 address

匿名

Could you tell, where did you find archivecaslytosk.onion ?

Wasn’t there archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion nearby ?

4 年前

I am interested in donating to support Archive Today but don't see any way to do that. Also, it seems as if Archive Today is not working through the Firefox browser. Seems to work through Chrome though.

匿名

I am using Firefox

I do recommend trying to invest some time to try and mess around with the webmaster tools for crawling by Google, Bing, Yandex, etc. There was many valuable pages saved on this project, but what's the use of them if people don't really know about it. An analogy would be public libraries during pandemic. People were unable to access such valuable information, until it was made available through Internet Archive Open Library. This analogy can be discredited through violation of copyright, however.

匿名

Own index (using ElasticSearch or Vespa.ai) looks more promising/realiable.

Even in those days when their index coverage was much better than now, there were various other problems: for example, porn snapshots were ranked much higher than the rest.

4 年前

Will you cut it out with "Error 503 Service Unavailable"?!

匿名

Backend was restarting (after crash or upgrade).

Should I make that page more funny like Reddit’s 503: http://archive.is/VnTMO

or http://archive.is/l4AYy

Or Twitter’s: http://archive.is/1P5rx

What is the trickiest site -- LJ! Large discussion not expanded again: Muiw5

匿名

fixed

4 年前

I'd like to also report an issue with the captcha page timing out when trying to submit / view articles. The page will partially load and then just fail, or it will give a connection timeout error without loading anything. I've tried using different DNS nameservers and tried using a friends internet connection on a different provider but the issue keeps persisting. Is there any chance you could use CloudFlare to reduce the number of bots trying to abuse the service?

匿名

No, there was a strange story there: all my domains were already banned by Cloudflare when I tried to add them to the CF control panel (I don’t know why, I never used CF before), but it happened that one archive user got a job at CF and solved the problem (although he didn’t reveal the reason for the ban). He worked there for about 1 year, the day after he quit CF banned the archive domains again, resulting in 10 hours of downtime. This was long before the drama with DailyStormer and 8chan, so it went unnoticed: there wasn’t a thread about CF fighting indie sites back then.

Another example of why money cannot buy a quality service if there is no personal connection and mutual interest.

Can you expand the comments on Invidious pages like z2VYw ? Thanks!

匿名

yes

4 年前

The entire bodies of text in both of these articles — 'z1MnF' and 'ssbHy' — didn't save. This seems to be an issue with Defense One, specifically. It happens on every page that's archived. Can you fix them? Thanks for everything you do!

匿名

yes, fixed. the adblocker removed too much

4 年前

For the past several days I've been unable to even reach the captcha page. After several minutes it loads partially, not showing the full elements of the page, and not allowing me to check the mark or to proceed. Not sure if I'm doing anything wrong. Same thing happens when I try to search for the link rather than submit link. Thank you

匿名

Please provide information about your network settings

4 年前

Instagram posts/profiles no longer working, redirects to /accounts/login/ even for content you don't need to login to view: Example: /R7mNt

匿名

There is no Instagram content which don’t need to login.

If you can access the page without login, it is sort of “promo preview“, after few pages accessed this way, they add your IP into “promo is over“ list and will redirect to /login on every future request.

I just have not enough fresh IPs to abuse this mechanism.

Barinsta-style looks more promising, if it still works.

4 年前

Would you mind adjusting the body of text in 'sTek0' so it is centered properly? Thank you kindly.

匿名

yes

4 年前

Can we do anything to help financially support the site? I've noticed that it's been slower in these past few months and would like to help keep the site fast. (I've even gotten timeouts when just loading the front page, not even loading archives / submitting new ones)

匿名

I do not think.

There will always be crawlers, submitters of SEO doorways, etc., ready to consume all the proposed resources, no matter how large they are. That is, there will always be some pessimized group, by IP, by DNS, by some other features, which will face slowdowns and excessive captchas, and ordinary users will fall into it.

Accounts do not look like a good solution too, it just shifts the same checks into the time of account creation: just try to create a Google/Facebook/Instagram account using VPN or Tor IP - there will be tons of captchas, timeouts, and vague “server errors”. Difficult account registration would prevent from quickly saving hot content, people will simply give up at this stage.

4 年前

Images attached in a forum post at HiAvM doesn't get archived. Could you look into it?

匿名

yes, fixed

4 年前

what is possibility of creating sitemap to allow for better crawling of saved pages for display on major search engines?

匿名

It is there, although in non-standard location submitted via Webmaster Tools. The problem is since 2018 there are almost no visits of search engine bots (one exception is bingbot which crawls like crazy but does not add pages to the index anyway, so I have to block it when it is too active)

4 年前

Recently I noticed "captcha while reading": I read some long page (book, long LJ discussion, etc.) and earlier archive kept my read position when reload page (close browser and reopen, etc.) But with recent introducing captcha request while just reopen (previously opened) page my read position not retained. This is quite uncomfortable. Please if possible do smth with it.

匿名

Captcha should not be there to read the page, only to submit.

The only exception is countering overly active crawlers which make significant load. That means captcha-to-read is almost permanently shown to Amazon, Azure, GoogleCloud, DigitalOcean, Vultr, Linode, LeaseWeb, WorldStream, … etc IPs, where are the homes of many crawlers and VPN exits.

4 年前

Can you please remove the cookie box on WLoSO. Thank you

匿名

yes

4 年前

The twitter page /1eLZW did not archive correctly. I think it might be an issue with the old format request added to the header. Could you look into it?

gfair

yes, it is available only in new design; fixed

4 年前

Can you please remove the cookie box on roBGz. Thank you

匿名

yes

4 年前

Can you delete the donation popup in 'yp1vL' at the top of the page? Thanks in advance. Not sure why it archived it for this specific page. It's never archived that popup before.

匿名

yes

4 年前

Is there any free or paid way to archive 1000 links with the help of coding like Python?

匿名

https://github.com/search?q=archive.today

4 年前

The footer on qG3Ly is, for some reason, near the top, covering part of the page. Can this be moved down?

匿名

I see no problem there

4 年前

Why is archive is so slow? It's been incredibly slow for about a month now in the UK. It seems more like a Cloudflare issue as even the bot check screen (Attention required/One more step) takes about a minute to load.

匿名

The choice to use Cloudflare is yours, not mine. You could opt-out by changing DNS from 1.1.1.1 to something else.

4 年前

Hello, have you thought about selling your project?

匿名

No.

In case of a money shortage, a more aggressive (Wikipedia-style) asking for donations might help.

4 年前

Is there a way to alter the archiving on this website to wait/include comments? I3spw

匿名

yes, fixed.

4 年前

For long time I noted that some branches in some expanded LJ discussions are present multiple times. This was not fixed with last fix ("expand"). Is it possible to investigate? See 2-times-branch "August 11 2021, 05:51:28 UTC", 3-times-branch "August 11 2021, 05:55:20 UTC", 4-times-branch "August 11 2021, 05:57:58 UTC" in 4mvnC

匿名

yes, there are some invisible “Expand” buttons which have been clicked too

4 年前

Is it possible that this project will become a permanent service like Google?

匿名

Is it a joke about 240 services https://killedbygoogle.com/ ?

4 年前

Are Google and Imgur links forbidden from being archived?

匿名

No, which links?

4 年前

Again not expanded several branches of LJ discussion (also note "More" buttons there): dmJKp

匿名

yes, the fixed version is not yet deployed to production. I rearchived that page manually

4 年前

Is it possible to expand all comments in substantial LJ discussions? Example (see below there): QR3I1

匿名

yes. There was a bug misclicking on some EXPAND buttons

You said that before you die of old age you would implement a download zip of your whole site. That's fine but links to archived pages will still be broken if you die if you don't have someone to follow in your footsteps to maintain the site because the site will go offline or somebody will buy your expired domain name using it for another purpose. Do you have plans for someone to take over your site? I have thousands of archived pages, don't want that work to go to waste.

匿名

archive-is:

daveymames:
archive-is:
I do not think there are many people willing to maintain such a project, which is also unprofitable. All 4½ projects over there - (IA, Archive.today, Megalodon.jp, half-suspensed WebCite, and paid Pinboard.in) look running on energy and money of a single person each and likely will be greatly changed or shutdown by the heirs.
I could only advise to save everything locally to sync your documents with your own lifespan. Do not rely on clouds.
You don’t need many people mate, just a small amount of people is all that’s required. I for example would be willing to accept a passing of the torch. I would fund it with my own money and allow people to donate. I’m planning a site similar to Archive.org of my own that allows uploading via torrents so you can upload big files which is hard to do on archive.org and it bans people who don’t keep 1TB of stuff permanently seeded. This way I don’t need to waste money on storage.
How much does hosting cost you per month at the moment?
about ~$2600/mo of pure expenses on servers/domains, not counting “work time”, “buying laptop/furniture”, etc. ($100…300/mo covered by donations + $300…500 by ads)
I’d suggest starting with pdf/djvu archive:
* It is of demand: people here often ask about archiving pdf/djvu and are particularly interested in archiving from another website rather than uploading (for some vague legal reasons).
* Unlike archive.is, it is more a blob storage and fit to “store me a terabyte” model: there is no need to develop and support own file formats and its renderers.
* There is a ready-made dataset to rescue and get some press attention on: Sci-Hub.
* The mission is more about “save forever“ than our “keep a page online after the original took down or altered“.

Also, https://docs.softwareheritage.org/ is a storage-heavy initiative which would need extra mirrors and crawlers. I need it as a user, especially immutable weekly snapshots of whole language repositories (such as maven.apache.org, npmjs.com, crates.io, …)

Recently, no matter which domain and browser i am using to retrieve or archive webpages, archiveis takes AGES to load. What's going on there?

匿名

DNS?

4 年前

Is your code open source? I’d like to use and modify it for a different purpose. Im assuming you used headless chrome but i’d be curious to know what else you used.

匿名

No, it is not: https://blog.archive.today/post/658456222842978304/will-the-code-ever-become-open-source-id-like-to

There is chrome, but not headless, just patched to add more functions to the remote debug protocol.

4 年前

Hello! Apparently ArchiveToday is having problems archiving Facebook pages. For example, here: archive ph Zdscy - instead of page's content the message about "Accepting Cookies" is displayed, in French. Also, ArchiveToday gets redirected to FB's login page during archiving when trying to archive full (non-mobile) pages. Hopefully, something can be done about it and ArchiveToday will be able to save FB pages again.

匿名

archive-is:

`https://blog.archive.today/post/658859868034318336/bonjour-sauvegardez-vous-des-comptes-instagram`

Facebook/Instagram accounts got banned again :(

The recent drama with alternative Instagram client “Barinsta” (it was removed from GitHub, the sources are still available on archive.org, they archive even Git repos!) highlighted that all public Instagram content can be retrieved without having an account, using only unauthenticated API calls.

So, Instagram archiving resilient to account blocking looks doable.

No idea about Facebook.

Hello! Apparently ArchiveToday is having problems archiving Facebook pages. For example, here: archive ph Zdscy - instead of page's content the message about "Accepting Cookies" is displayed, in French. Also, ArchiveToday gets redirected to FB's login page during archiving when trying to archive full (non-mobile) pages. Hopefully, something can be done about it and ArchiveToday will be able to save FB pages again.

匿名

https://blog.archive.today/post/658859868034318336/bonjour-sauvegardez-vous-des-comptes-instagram

Because you have multiple domains, can you tell me which TLDs are the safest in terms of takedowns (DMCA etc)?

匿名

.today, because it has no content, only redirect to another domain

4 年前

You should use hCaptcha instead of reCAPTCHA. It's free, just as effective and way less annoying for the user.

匿名

No, it is much more annoying.

For the past couple of days, when I try to save pages, the Attention Required! page for captcha is either blank or the captcha header is loaded but not the rest of the page or captcha. I have to reload the page several times before it either goes back to the save page where you enter the url or captcha prompt works. This is annoying.

匿名

Please supply such reports with URL the page you accessing, your IP and IP of the server you connect to.

4 年前

is it possible to save a site continuously with a periodic schedule?

匿名

sighinastorm:

archive-is:
No
No? Funny. This was a common feature of web-viewing/crawling/browsing applications in the early-to-mid 1990s. How strange, the ways we frequently walk backward into our own footprints technologically.

Because it is a free service running on shoestring budget. The need to perform a manual action limits the resources consumed by one user, leaving something for others.

is it possible to save a site continuously with a periodic schedule?

匿名

No

Hi, do you know what font is used in plain text archives (images), such as qnqmT/image ? Thanks!

匿名

Looks like some programmer’s font leaked from the workstation: JetBrains Mono or PragmataPro Mono

4 年前

Is the website down? It's very slow. downforeveryoneorjustme is showing that it's down as well.

匿名

No, it works.

4 年前

If possible, would you mind fixing 'RQPbP'? The archiving process didn't save any of the actual text from the article. It's basically just a blank page. Thanks in advance (if you can help).

匿名

yes

4 年前

Can you please fix /3qBql, thank you

匿名

yes

4 年前

Will archivecaslytosk.onion be upgraded to Onion version 3.0 site??

匿名

archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion

4 年前

Could you fix iqoly please?

匿名

No. I (as a human) see infinite loop “checking your browser“ too. Try archive.org or Google cache.

Expand all on vPjiq?

匿名

yes

4 年前

Image omitted at "npYKs" , and re-archiving is not working (just shows npYKs again and again) . Could you help this?

匿名

https://archive.is/MZ8mK

4 年前

Cannot archive anything. Says "Server Error" Anyone else having this problem?

匿名

Just out-of-memory.

I will fix in few minutes.

4 年前

Why is it so tediously slow? I have to use a VPN every time I have to snapshot a page. Today I got an error message saying "this device is paused".

匿名

Can you provide more info about your network ?

Bonjour, sauvegardez vous des comptes Instagram ? Si oui, depuis combien de temps ? Combien de comptes Instagram sont présents dans vos bases de données ? C'est pour un travail de recherche en Master 2 Photographie. Merci de votre aide, cordialement, Julie T.

匿名

I found an 10 years old Facebook account (which is valid for Instagram too). It seems that Facebook blocks old accounts only for few hours on untypical usage, not forever as recently registered accounts.

So far it works, but sometimes it results in a snapshot with “Bloqueo temporal. Parece que has usado de forma indebida esta función por ir demasiado rápido. Se te ha bloqueado temporalmente y no puedes usarla.“ instead of the content.

I have no fallback accounts to handle this.

If someone can donate old FB accounts, it would be helpful (I know there is a black market, but I am not ready to pay to keep FB/IG archiving active).

4 年前

This page got while livejournal archiving: czS2f

匿名

fixed

4 年前

I've noticed that the captcha renders empty when the archive URL has a percent notation in it, e.g., archive/7wmKm#42% when a captcha is required doesn't have anything in place of the captcha.

匿名

yes :(

technically, recaptcha is correct failing on this, http://archive.today/7wmKm#42% is not a valid url, it should be http://archive.today/7wmKm#42%25 following the standard, but #42% was there before recaptcha.

It seems that I have to copy recaptcha.js from google servers and fix it locally.

4 年前

Could you open all the "Learn More" sections in gJKLQ?

匿名

yes

4 年前

On kTcp6 you are redirected to an adblock as of today. Can you please commit this, but keep this block once. Thanks

匿名

Fixed. We updated Chromium recently (85 -> 92), this caused changes in interaction with some sites

4 年前

Can you please remove the cookie box on mCmko. Thank you

匿名

yes

4 年前

Show all depot files on SteamDB like on D93hv?

匿名

Fixed for existing snapshots. If you are going to save more pages like those, it won’t for them until tomorrow’s browser update (I have it locally but not on the servers yet)

4 年前

Could you please remove the cookie box on /rZEkc and /YbFR4 ...? Thanks!

匿名

yes

4 年前

Can you please make the individual pages visible on N3rhD (#slide1, #slide2 ...). Thank you

匿名

yes

4 年前

Ability to skip captcha for "donors/subscribers"?

匿名

Maybe in the future. Currently, there are no accounts so no info on which visitor is a donor

4 年前

Will the code ever become open source? I'd like to run my own instance if possible.

匿名

Unlikely. It has too many hardcoded things specific to my installation. From the type of hardware (like ”that server is too old that it requires kernel-4.4 with a specific patch”) to using a quite exotic operating system.

There is plenty of open-source software in this area: https://github.com/iipc/awesome-web-archiving

Could you close the math input popup and the cookie popup for dhySF?

匿名

yes

4 年前

Can you remove the pop-up of /0ZhZY ? Thanks

匿名

yes (it will be deployed in ~10 minutes)

4 年前

Hi, can you remove the Convey popup ad from rJEO1 ?

匿名

yes

4 年前

Could I setup a site to automatically monitor Twitter accounts with over 10,000 followers or so & automatically backup new Tweets from those accounts? My website will use your site to make a backup of a Tweet as normal on your site then my site will have a page with a link to all that person's archived Tweets. I want to do this to catch politicians out who say bad things then try to delete their Tweets to erase the evidence. Is that only possible with AP access & does your site have API access?

匿名

archive-is:

daveymames:
archive-is:
Twitter will likely ban us. We often receive “429 Too many requests” answers from Twitter.
AFAIK, some library (Library of Congress?) does save all tweets in realtime, so you might use them.
The Library of Congress only backup selective Tweets.
How many requests need to be made at the same time to get the “too many requests” error? Is there any way to prevent getting that error?
Doesn’t seem like they would ban you because instead they just temporarily block your site from making requests?
Currently, there are 5-10 saves per minute from Twitter. Another reason to use special tools is not to waste megabytes of storage to save only 140 characters. It’s better to create `twitter-archive.today` to tailor twitter.
And… there are already few “thread unrollers” which do exactly that.

There is also https://github.com/docnow/twarc for mass-archiving from Twitter.

Thank you for your project! it's amazing and very usefull! It's appear to me that archived webpages are not adaptive to different screen resolutions (for example for mobile phones). Any plans to that direction?

匿名

archive-is:

I guess, no.
1. It is difficult to do reliable, as websites with mobile versions implement it differently. Sometimes it is the same page with separate CSS, but often different pages on different domains (like `m.facebook.com`)
2. Mobile versions strip some content. One might post a link to an archived page from a desktop citing some content, but a mobile reader won’t see it. Currently, everybody sees the same, at the price of mobile users with too small screens have to zoom in.

Archive.org recently switched to use Chromium making the two systems closer. They keep active scripts which makes the archived copies adaptive to the screen width. But there are some drawbacks: the remaining scripts control user experience (for example on http://web.archive.org/web/20210801141633/https://www.t-online.de/unterhaltung/stars/id_88994334/karl-dall-79-sein-letztes-video-sorgt-fuer-gaensehaut.html the script blocks scrolling and removes Instagram embed), and scripts can perform AJAX requests to random locations:

On contrary, Archive.Today’s snapshots have no scripts and behave more static like images or documents, but as a drawback, they are not adaptive.

I have noticed that Google hosted sites do not archive. Especially blogpost. In some areas the archive normally. Maybe due to where their nearest server is.

匿名

I do not know if it covers your case (if not - please provide mode details), but some pages on Google websites (groups.google.*, docs.google.*, …) require account, and Google forcefully logs users out if they are using old (vulnerable) Chromium. I am going to upgrade Chromium in 1-2 days.

4 年前

Could you press "Not Now" on LHK9n?

匿名

yes

4 年前

Have you considered allowing small mp4s and webms (<3MB), basically gifs, to be archived?

匿名

archive-is:

Videos are allowed on some websites (Twitter, Imgur, Wired, MIT Technology Review, …).
There is another obstacle besides the size: Chromium often returns broken data when video content is requested via DevTool Protocol (using Network.getResponseBody function). Probably they have already fixed the bug, I need to check.

It seems fixed, even with relative big videos (example https://archive.md/IDsHJ). I will deploy the fixed version in 2-3 days.

Thank you for your project! it's amazing and very usefull! It's appear to me that archived webpages are not adaptive to different screen resolutions (for example for mobile phones). Any plans to that direction?

匿名

I guess, no.

1. It is difficult to do reliable, as websites with mobile versions implement it differently. Sometimes it is the same page with separate CSS, but often different pages on different domains (like `m.facebook.com`)

2. Mobile versions strip some content. One might post a link to an archived page from a desktop citing some content, but a mobile reader won’t see it. Currently, everybody sees the same, at the price of mobile users with too small screens have to zoom in.

Hi,My name is Conor from Infolinks, and I would like to purchase advertising on your site. Are you available for a call this week to discuss it? We represent dozens of national advertisers such as Red Bull, Barnes & Noble and Kia.I look forward to hearing from you and setting up a time to chat.

匿名

Do you have an email? Or just a signup form? Telephone conversations in English is not my strong point.

4 年前

As current patrons of this service, should we as users either: 1. promote this website to others to help preserve important websites, 2. Keep silent on our knowledge of this database/service, 3. Stop using the service entirely?

匿名

I’d say “no” to all three.

1-2. the website has been working for 9 years already and is quite well known (random people I meet offline know), it is hardly possible and hardly necessary to change anything much here.

3. why?

Not respecting people's privacy, copyright laws, or the veracity of content on your website... Please tell us more about how this archive isn't being well managed and is doomed to die at any moment!

匿名

Of course, it is doomed to die at any moment (you should not have any illusions, as well as about the “veracity of content” on the Internet). The only idea is to hold back a little something that is doomed to die a little earlier. I hope that it is obvious after all the deplatforming dramas of the last months (disappearance of @realDonaldTrump, etc)

will you remove a website archived from your site, under a formal DMCA notice?

匿名

Usually, no.

1. DMCA applies only to US companies. And it is not something they must obey, it is about providing safe-harbor to Internet companies if they follow. Not being in the US, we do not receive this privilege.

2. It is prone to bogus removals (there are studies on this topic https://www.google.com/search?q=ChillingEffect+bogus+dmca+notices). For example, Twitter has removed our logo from https://twitter.com/archiveis following a formal DMCA notice. Tumblr (where blog.archive.today is) received the same letter and ignored.

3. Indeed, relations with ISPs/registrars are slightly aggravated by ignoring DMCA notifications but voluntarily following them will not change anything. I disclosed a few days ago that even bare domains without any content were attacked and hijacked. A letter like “there are million stolen bitcoins on that server“ or simply something hysterical is more effective than formal ones. And much more often.

We are close to Telegram in this respect: illegal content is removed by requests of authorities (or when we can predict the position of authorities) but “I do not like it and want to shut down“ wrapped in a form that mimics a lawyer’s letter - no. That undermines the idea of a webpage archive. If we follow this path, the first step will be to remove what we do not like ourselves.

In the time of proxies the submitter ip is of valuable information only together with the exact time when the connection was made (so they can trace the connection to a specific ip). -- On the other hand the exact time of the page archived is an information of value. -- The question is how the link between ip-address and the connection moment can be scrambled.

匿名

If you expect such an orchestrated (me, proxy operator and your home ISP) action against you just for submitting a page to the archive, use Tor. Or proxy via Tor via proxy.

The scrambling task looks far-fetched. Sort of things that students do for grants, like removing racial prejudice from neural networks.

4 年前

Well, to be fair, it would also be a good idea to have someone take over archive is, if you do die of old age. I don't have a problem with one big zip file, but what if people want the site to continue? Maybe there could be people who love your projects and want to continue archive is. I know sites shut down eventually or get removed by ISPs, but Maybe you can start a ISP?

匿名

I heard a story on Minecraft guys frustrated by the unreliability of their domain registrar under complaint storm originated from their competitors so they established their own domain registrar (50k$ setup fee) to serve their own 3 domains. It failed within a year.

The problem is not that ISP/hosting/domain guys are motherfuckers, the problem is it is a high-competitive business saturated with fear, uncertainty, and doubt. They have to play the game “we are cute, it is our clients who are evil, we have already canceled them” or be canceled themselves (the fate of clients is unenviable as well as the “senior”’s). When you are the only customer of your own registrar you are an anomaly and more than vulnerable.

That is why I prefer national (two-letter) domains, at least a national registry has no angst of being canceled (a good illustration is archive.li’s drama: as soon as the Swiss national registry ceased working with end-users and passed them on to resellers, the reseller “switchplus ag” quickly canceled “archive.li” on the first anonymous complaint worrying about its newfound status of big reseller), and the only FUD to act here are personal ones of particular employees.

4 年前

What's the point of keeping tracking of submitter ip again? There is tech to evade giving out real ip, such as proxy, vpn, onion routing, etc.

匿名

Mostly to combat SEO spam, by clustering new snapshots by submitters. Spammers typically use the same VPN company, so patterns in submitter IPs complement patterns in text on snapshots. Also, stored IPs are essential to tighten CAPTCHA rules against an active spammer.

Of course, you can save a page anonymously. It is exactly what the website for: to save a page as quick as possible, without creating accounts, confirm email/phone, bind credit cards. But you cannot save 10000 pages with “buy v1agra”. There are no user accounts, so they are simulated by various heuristics.

4 年前

In the near future, once full archive finally available for download, will each snapshot include the submitter ip address?

匿名

Well, it is a good point against exposing/uploading the archive database in its internal form :)

4 年前

Since the site began which would you say has outpaced the other: the growth in storage space needed or the growth in space you can buy per dollar? Do you see the site becoming cheaper or more expensive to run as time goes on?

匿名

No, it does not grow much last months. It is not about storage: after migrating from PhantomJS to Chromium the pagesaving process got slow and heavy, so CAPTCHA was introduced and ruled out mass submitters who use bots and scripts. Storage prices never were the bottleneck. In the first years it was disk I/O and bandwidth for distributing content (mainly because of bingbot and googlebot), now CPU for the browsers.

There are still unimplemented ideas to be leaner in storage, such as erasure codes instead of data duplication, etc.

4 年前

I deleted my personal Instagram a few days ago and I noticed that the old URL was archived around the same time on this site. The archived page comes up as "Page not found" so it doesn't show any personal info but I'm curious. Do you automatically archive deleted instagram accounts or was somebody searching my name and archiving it?

匿名

Somebody was searching your name and archiving it.

May you create throwaway tumblr account to save login restricted blog?

匿名

I tried. But I do not understand how it supposes to view login restricted blogs. The restricted content is there but in a very narrow column.

4 年前

Following up on your project blog response, what are the other thread unrollers that save Twitter tweets?

匿名

https://www.google.com/search?q=twitter+thread+unrollers

4 年前

You said that before you die of old age you would implement a download zip of your whole site. That's fine but links to archived pages will still be broken if you die if you don't have someone to follow in your footsteps to maintain the site because the site will go offline or somebody will buy your expired domain name using it for another purpose. Do you have plans for someone to take over your site? I have thousands of archived pages, don't want that work to go to waste.

匿名

daveymames:

archive-is:
I do not think there are many people willing to maintain such a project, which is also unprofitable. All 4½ projects over there - (IA, Archive.today, Megalodon.jp, half-suspensed WebCite, and paid Pinboard.in) look running on energy and money of a single person each and likely will be greatly changed or shutdown by the heirs.
I could only advise to save everything locally to sync your documents with your own lifespan. Do not rely on clouds.
You don’t need many people mate, just a small amount of people is all that’s required. I for example would be willing to accept a passing of the torch. I would fund it with my own money and allow people to donate. I’m planning a site similar to Archive.org of my own that allows uploading via torrents so you can upload big files which is hard to do on archive.org and it bans people who don’t keep 1TB of stuff permanently seeded. This way I don’t need to waste money on storage.
How much does hosting cost you per month at the moment?

about ~$2600/mo of pure expenses on servers/domains, not counting “work time”, “buying laptop/furniture”, etc. ($100…300/mo covered by donations + $300…500 by ads)

I’d suggest starting with pdf/djvu archive:

* It is of demand: people here often ask about archiving pdf/djvu and are particularly interested in archiving from another website rather than uploading (for some vague legal reasons).

* Unlike archive.is, it is more a blob storage and fit to “store me a terabyte” model: there is no need to develop and support own file formats and its renderers.

* There is a ready-made dataset to rescue and get some press attention on: Sci-Hub.

* The mission is more about “save forever“ than our “keep a page online after the original took down or altered“.

Could I setup a site to automatically monitor Twitter accounts with over 10,000 followers or so & automatically backup new Tweets from those accounts? My website will use your site to make a backup of a Tweet as normal on your site then my site will have a page with a link to all that person's archived Tweets. I want to do this to catch politicians out who say bad things then try to delete their Tweets to erase the evidence. Is that only possible with AP access & does your site have API access?

匿名

daveymames:

archive-is:
Twitter will likely ban us. We often receive “429 Too many requests” answers from Twitter.
AFAIK, some library (Library of Congress?) does save all tweets in realtime, so you might use them.
The Library of Congress only backup selective Tweets.
How many requests need to be made at the same time to get the “too many requests” error? Is there any way to prevent getting that error?
Doesn’t seem like they would ban you because instead they just temporarily block your site from making requests?

Currently, there are 5-10 saves per minute from Twitter. Another reason to use special tools is not to waste megabytes of storage to save only 140 characters. It’s better to create `twitter-archive.today` to tailor twitter.

And… there are already few “thread unrollers” which do exactly that.

Could I setup a site to automatically monitor Twitter accounts with over 10,000 followers or so & automatically backup new Tweets from those accounts? My website will use your site to make a backup of a Tweet as normal on your site then my site will have a page with a link to all that person's archived Tweets. I want to do this to catch politicians out who say bad things then try to delete their Tweets to erase the evidence. Is that only possible with AP access & does your site have API access?

匿名

Twitter will likely ban us. We often receive “429 Too many requests” answers from Twitter.

AFAIK, some library (Library of Congress?) does save all tweets in realtime, so you might use them.

You said that before you die of old age you would implement a download zip of your whole site. That's fine but links to archived pages will still be broken if you die if you don't have someone to follow in your footsteps to maintain the site because the site will go offline or somebody will buy your expired domain name using it for another purpose. Do you have plans for someone to take over your site? I have thousands of archived pages, don't want that work to go to waste.

匿名

I do not think there are many people willing to maintain such a project, which is also unprofitable. All 4½ projects over there - (IA, Archive.today, Megalodon.jp, half-suspensed WebCite, and paid Pinboard.in) look running on energy and money of a single person each and likely will be greatly changed or shutdown by the heirs.

I could only advise to save everything locally to sync your documents with your own lifespan. Do not rely on clouds.

Please if possible consider internally shakko ru as livejournal com for sake of all comments unrolling.

匿名

yes

4 年前

Tbf, you may need to consider a plan if you die of old age. It's not a bad idea to think about.

匿名

The plan is to implement full-text search and to restore “download zip“. Besides being nice features, their combination would allow concerned people to discover pages of interest and make a local copy.

About the IA Backup: YOu said that it'll probably be the first to go - no, it wouldn't. IA stores stuff "forever" so long as they aren't too objectional. You can upload anything (though with this size, you'd be better off contacting an admin first).

匿名

I meant if there will be a live clone (just backup is useless because of exotic and constantly changing file format), one day they turn the wire off.

Long before starting the archive I came to the conclusion that any Internet project can survive only as a moving target. Almost everything I had (working websites, “investment” domains without any content, …) got lost due to random actions of ISPs or domain registrars, so the archive was the obvious idea of The Ark, keeping the webpages while being the moving target itself, resisting the instability. So, the goal was not “store forever” but merely to survive in The Storm (and to make the basement for other projects), here we add some dynamism to the IA’s mission - not only by saving dynamic webpages. All the dramas were expected, or better to say, the same issues were expected to happen to any other project (as long as it has a server or a domain), unnoticed, and kill it. The Archive was the only doable idea with chances to survive.

Hi, what happens when you die of old age? Does your Archive site get taken over by a charity so people can continue using it forever? Thanks

匿名

I expect that a single mobile phone will be capable to contain full copy of the archive much earlier than I die of old age.

Also, I see those questions as affected by using of word “archive“ in the project’s name. No one would ask about retention of, for example, Scribd’s collection of documents, because it is clear to everybody that it will get lost as soon as their business conditions change.

Have you considered allowing small mp4s and webms (<3MB), basically gifs, to be archived?

匿名

Videos are allowed on some websites (Twitter, Imgur, Wired, MIT Technology Review, …).

There is another obstacle besides the size: Chromium often returns broken data when video content is requested via DevTool Protocol (using Network.getResponseBody function). Probably they have already fixed the bug, I need to check.

Is there a limit to how many times a page can be saved in some given time period?

匿名

There is no hard limit. There are some tricks to enforce fair use. The more similar pages in the queue the less priority they have, etc.

4 年前

Can you please remove pop-ups on the Centre Com website? i.e. YxiQO, qfXhy, 1FhST, etc

匿名

yes

4 年前

Why did Instagram pages used to be savable on archive, and it seemed it was logged into an account? What happened to this feature?

匿名

Because Instagram and Facebook quickly ban accounts which bring no profit to them. It was not so quick, accounts used to live many months and years.

You might notice that screenshot services fail on FB/IG pages nowdays. Link previews in Telegram fail on FB/IG pages. Etc. It was not so few years ago.

PS. there is a counter-process, though: archiving of YouTube works much better now, it used to show captcha years ago.

IA wouldn't need to host a live copy, just keep backup of the sites' files. 4plebs and other 4chan archives regularly upload backups totaling in the terabytes. IA also has their subscription service Archive-It which hosts a text-searchable copy of a website.

匿名

And who will bring it to live? It is not PDF or WARC with tons of well-documented tools.

Could you (or anyone) make a mobile app for Android so that I can share a link to the archive?

匿名

https://play.google.com/store/apps/details?id=com.navasgroup.share2archive

4 年前

What happened with all archive md slash habrahabr ru savings? Were 20242 urls at 2013.09.18 (I keep this exact number then). Now just 1874 urls.

匿名

Long results are truncated for performance reasons (like on any search engine). To get more results try to use something like:

https://archive.md/http://habrahabr.ru/company/a*

https://archive.md/http://habrahabr.ru/company/s*

4 年前

Please remove popups if possible: AydT7 2VNsx

匿名

yes

4 年前

Can you please remove the cookie box on x6DSb. Thank you

匿名

yes

4 年前

Is there technically the possibility to select with a checkbox before saving a page if you want to save a cookie box or not? Since it can be possibly also interesting to see the layout completely, even if these boxes mostly disturb.

匿名

I am not sure, it is more complex than yes/no question.

1. cookie box appearance is not guaranteed. Many websites show it only to visitors from particular regions. Or different cookie boxes to different regions. Archiver’s region is random.

2. on many websites a cookie box must be accepted, not just removed/closed. Otherwise they will not display Twitter and YouTube embeds but empty rectangles.

3. for some websites cookie boxes are combated proactively, by sending requests with cookie “I have already seen the cookie box“. These rules decay with time so not reliable.

4. on old snapshots (which made before the cookie box was reported/spotted) it is removed in the post-processing step: it is still there on graphical screenshot and removed on html. This is the only good case for switching to complete layout forth and back.

5. currently removal of cookie boxes is not separated from other layout fixes, most of them are pure bugs (pages made for exact browser version which is now outdated, …)

so it is too messy :(

4 年前

I am unable to save any Instagram profile/photo, e.g. epicgames. Can you do something about it?

匿名

no

4 年前

Why Archive Today can't save any PDF? Is it a technical or legal problem?

匿名

technical

Why can i archive Instagram posts? Can Facebook videos also be archived?

匿名

It needs Facebook accounts.

4 年前

Show all comments on ub0Gy?

匿名

yes.

also fixed ugly banner spaces on other snapshots from kotaku.com.au

4 年前

Not to be rude but you seem blasé about a scenario where the site disappears. So much internet history would be permanently lost if that happened. What's wrong with giving a backup to the Internet Archive? Or seeking help for a blockchain solution? If you put a donation drive for a backup on pages (or just on the main page) or for tech advice plenty would be eager to help. Contact IA and I'm sure they'd be glad to help too.

匿名

Even if we assume that IA offers cheap/free cloud hosting (I never heard of) capable to run another copy, I’d bet it will be the first copy to die, estimating its lifetime as 1-2 years after the experience with the paid clouds.

4 年前

If the site eats your money, why do you keep doing this? Do you have a regular job at like Google, resting and vesting? :) With so much money in tech, it's really impressive people still do OSS work and the side projects like this one. All the best to you, and thank you so much for your work! I started coming to the blog to read more about the project, and I'm a very big fan of yours. :) CM.

匿名

No, it was peeep.us’s (a defunkt website similar to archve.today) webmaster who worked for Google.

Can you please remove the cookie boxes on 5zCeB, NeUT6, uBuvf, vlqrA, sXnlQ, UF1MA, 1YERr, GvYuR, VpXIV, 0mja8 and 4ed9y. Thank you

匿名

yes

4 年前

What ever happened to Liberapay for donation?

匿名

It works, and “donate” button on snapshot pages goes to Liberapay

4 年前

How does this website earn you money? Does it help you if we save more pages or do you prefer we save as few as possible?

匿名

It does not earn me money, it eats my money. There are ads on some pages and donations, they cover about 1/7..1/5 of expenses.

As few as possible would be polite to other people, they won’t have to wait in the queue.

4 年前

Please place the mark in the Checkbox and click Next on /L8L20. Thank you.

匿名

yes

4 年前

Are there any plans on providing error messages for failed archives? For example "archive failed due to received 401 response of target"

匿名

Yes

4 年前

/rYVZc seems to have failed. Any idea why this might have happened?

匿名

https://ci6.googleusercontent.com/proxy/hdRsqocLRfrqFueUn-M34D3tueecFkr9xXRW22iO7e3F9oEcMiRVGyOZtd8I_CR3k5DKcaiLeIo4KXeMnx7YbyyHxCifL_bTRyVodgqwpvWXNxe4FbmqoQWmNAFPRghCdSOhv4RGWYJzjg_wV2lcxHTyVGJ8EUz7jKEO94iAqLZKTnsBePJ-krxOdEPG5fv9Wq1MDKM=s0-d-e1-ft#https://img.theepochtimes.com/assets/uploads/2021/07/14/2021-07-13T231658Z_1_LYNXMPEH6C1C1_RTROPTP_4_BRITAIN-SECURITY-550x330.jpg

Browser tries to download file to disk instead of showing, so the page remained empty

4 年前

Hi, to me it appears that archive today is more or less an anonymous website. How can I be sure that it's not a short lived website that is gone in one year or so (and all data with it)? Providing a full copy of the archive today database to the community, would probably increase trust and reliablility. Maybe one could even store this in a blockchain or so.

匿名

1. Any website could gone.

2. It has nothing to do with anonymity. Remember Google Reader or the fresh case of Yahoo Answers. On the other side: anonymous Histats, LibGen, Flibusta, Pastebin, Robtex, … work for decades.

3. There is no community.

4. I do not believe that blockchain guys are interested. They have more profitable ideas on how to use petabytes of storage. Optimizing for $$$ would kill the project very fast.

4 年前

Hi, why does "archive today" exist? Do you not trust "archive org"? It also has a function to archive a single page manually.

匿名

1. It is a different thing, the similarity in names is confusing. Our idea was not to archive the entire Internet, but to preserve short-lived content and allow to cite it in later discussions.

https://blog.archive.today/post/642952252228812800/people-often-compare-various-features-of

2. archive.org did not have the feature back then. Also, it did not work for many sites (some because of `robots.txt`handling, other because of heavy JavaScript and dynamic load of images). Now it works better and covers some cases we were unique in.

4 年前

Are you able to search internally by submitter ip, and do you also log ipv6?

匿名

yes (although slow, the field is not indexed), yes

4 年前

Will you make a v3 onion site for Archive Today? It's been very useful and I'd hate to see it go.

匿名

It works for me

http://archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion

4 年前

This box won't let me paste a page link! I personally saved it here, checked that it was saved & accessed it here many times. Last I checked was 2 months ago. The troll deleted it off IMDb all hard work gone, and where is the page that I saved on here? Can you please find it?? IMDB page go there and search tt0709543 & trivia page I can't post the real link! Ep title is: Starsky vs Hutch or the 2nd to last (episode before the finale). Can you please fetch the link and search it here? thanks

匿名

http://www.imdb.com/title/tt0709543/ was never saved here.

May you mistake with archive.org? It has few saves at http://web.archive.org/web/*/https://www.imdb.com/title/tt0709543/

4 年前

Thanks 4 reply. Deleted pgs are IMDB trivia. I searched every which way I can for and can't find it. There are some obsessed fans going around deleting perfectly valid trivia off IMDb and mods do nothing when serial offenders reported. Ex: episode "Fatal Charm" of Starsky & Hutch had trivia about being based on Play Misty for Me with Clint Eastwood. I added about Fatal Attraction. The page is 100% gone from here! Why? (same with many others I've looked 4!) Yes, I had checked they were saved.

匿名

oh, there are 100,000+ pages from IMDB.

We’ll have to wait for full-text search implementation unless you remember the exact link.

Why are pages deleted?? Recently saved a few months ago?? ALL GONE! Why??? How? Who is doing this and how does one request a delete from here???

匿名

Which pages? Likely, you just having difficulties to find them because of http/https or uppercase/lowercase difference. Because on the pages hidden by the requests of authorities there are the name of those authority, and if you have not seen that then your pages are not hidden and should be online.

4 年前

What does the "same screen" icon mean on the top right of some archived screen shots?

匿名

Try to click and see :)

4 年前

Somehow the twitter trending topics page isn't archiving correctly. /fXIdm Could you take a look at it?

gfair

It is one of the pages not available in old Twitter’s design. Fixed.

4 年前

Do you ever edit anything in the archives?

匿名

Sure. All the answers “yes“ and “fixed“ here mean altering the archive: removing a hovering modal, unfolding collapsed blocks, etc

4 年前

Can you please remove the Cookie box on VloJq. Thank you

匿名

yes

4 年前

hello why are all the reports that I make to you for terrorist propaganda material not dealt with?

匿名

Please send your reports to NCTPOC.CTIRUPublic@met.police.uk,
irma_DE@europol.europa.eu or oclctic-liste@interieur.gouv.fr. We don’t have the necessary experience in checking those materials, so we trust official agencies and not process anonymous reports.

Can you disable the video autoplay in /H5Wmf (the URL in Redirected from) to prevent it from going to the next video? Thank you.

匿名

yes

4 年前

How long is the IP address retention period? Also, is our information protected?

匿名

> How long is the IP address retention period?

Access logs - 1-2 monts, submitter IP - forever (it is included into snapshot)

> Also, is our information protected?

Of course, no. As we see in the news, everything leaks one day. Saying “protected“ and tomorrow “I am sorry“ would be a hypocrisy.

The safe assumption is to treat what could be leaked as already leaked.

When I take a snapshot, is our IP address taken and saved?

匿名

yes

4 年前

Can you please remove the coockie boxes on XnUgi, LKnRW and sFKA6. Thank you

匿名

yes

4 年前

Can you press More in woD3h?

匿名

yes

4 年前

can you click yes visit this profile on /WMRVK

匿名

yes

4 年前

Can you take down the sensitive content block in /XxnTP?

匿名

yes

4 年前

I would love to build a site like this for myself. Do you make the code available anywhere or on github? Is there an open source model you'd recommend?

匿名

It seems that archivebox.io is the closest open-source alternative

How much money would you need to get the archive to work fast again?

匿名

archive-is:

There is no problem with money shortage.
The problem is that during the course, the underlying layer - providers, hosters, CDNs, domain registrars, billings, … - showed itself to be very unreliable (there are some exceptions, but that makes them critical points).
When there are a lot of people/companies happy to steal $3 (literally) or cut the wires at the requests of anonymous trolls, how to put more money into that?
I would not dare to build something heavier or more expensive on such a foundation.

Someone may argue that the archive has pages from Parler, DailyStormer, SciHub, etc, so no wonder it is attacked and faces the same problems. Hide that content to solve the issue.

The irony is the archive have had almost no issues with that content.

We have our own types of attackers. For example, people with obsession to completely wipe some story from the Internet, something like “I wrote an essay about Derrida 15 years ago, it might be non-PC now, so I must ensure that the essay is gone as well as all citations and its very title which is mentioned in some old blogs”. Providers often take their side rather than side of a paying customer (sometimes by cutting the wires even without notifying us or they own support, so it looks like a technical problem for few days). Because complainants are annoying and unique while paying customers are easily replaceable units with known cost of attracting.

The weakness of an objectified customer undermines my faith in solving something by increasing expenses.

Can you take away the blurring/blocking of content at /YsnPS? Thanks in advance.

匿名

No, it requires free registration but the website is already down yes

4 年前

/TJbuX#selection-10179.0-10183.1 Can you make the crawler click on "more"?

匿名

yes

4 年前

Can you please save CrBPQ without Cookie-Box. Thank you

匿名

yes

4 年前

How much money would you need to get the archive to work fast again?

匿名

There is no problem with money shortage.

The problem is that during the course, the underlying layer - providers, hosters, CDNs, domain registrars, billings, … - showed itself to be very unreliable (there are some exceptions, but that makes them critical points).

When there are a lot of people/companies happy to steal $3 (literally) or cut the wires at the requests of anonymous trolls, how to put more money into that?

I would not dare to build something heavier or more expensive on such a foundation.

Can you please click the "open/close all folders" button and the small word "note" on all the archived page of tvtropes(.)org? For example: MMUZ0, EPxuI, CU9PL

匿名

yes

Can you click on "Click here to Continue" in the box of /XquKv? Thank you.

匿名

No, clicking on “Click here to continue” does not allow you to move forward, but only refreshes the current page

5 年前

can expand all the pluses, and get rid of the survey, at /F6aYO (wework-all-access-24-7)? Thank you!

匿名

yes

Why there are so many tasks in queue these days?

匿名

There are many low-priority tasks

5 年前

How many questions/enquiries do you receive every week? How do you choose to reply them or not?

匿名

The majority of questions/enquiries would better fit into full text search box search (like “Covid CDC card“, “who is the best bowler in the world“, …)

5 年前

Given that domains for archive[.]is/today/etc change frequently, is there a catch-all name for the service?

匿名

`archive.today` supposes to redirect to a working domain

5 年前

Can you make it so spark pages like /F6HfJ are fully archived? If possible

匿名

Looks doable but not easy. I add it to the backlog

Can you make it so /IfBGX let you see the work in this? Thank you.

匿名

yes

5 年前

can you please fix the link to the video on mE4Fc? thank you

匿名

No. This page is recovered from paywall preview, there was no video. I am not sure if the article is complete.

5 年前

Was there noticeable traffic increase today, because archive [.] org is down from power blackout?

匿名

no

5 年前

Can you please remove the cookie box on qH90o. Thank you

匿名

yes

5 年前

Do you have any comments related to this hacker news post? "Does anyone know why archive-is tracks who has read an article. If we look at the HTML from archive-is we see they include an image link to a domain name that contains the user's IP address. Popular browsers not only run arbitrary Javascript by default, they also access image links by default. Thus the archive-is DNS server has a record of every time the page is viewed in one of these browsers" news.ycombinator[.]com/item?id=27498902

匿名

It is not for tracking individual users.

It is to match source regions of DNS- and HTTP- requests, to help DNS-server to decide which HTTP-server to include in the next answers: the closest (as for the classic CDN function) or the most resilient to the content problematic in a particular region (for example, Russian hosters don’t give a shit about the American agenda (woke, alt-right, …) and vice versa)

That is the same feature which Cloudflare’s 1.1.1.1 broke for the sake of their “privacy“ marketing.

5 年前

Do you ever plan to use cryptojacking (with user consent) to raise revenue and monetize the site traffics to pay for the evergrowing servers?

匿名

Unlikely. I do not follow crypto news and even missed Chia hype which could be mined on free disks.

Probably, archiving web pages on the blockchain could be a monetization feature, so that the buyer of tokenized snapshots can be sure that the page is really saved forever (as their belief in crypto) and will not be censored.

5 年前

This archive is a very nice service. However, I think it would also be important in this age if it were a screenshot of the mobile view of a responsive website as well. Do you think this would be possible?

匿名

The archive already has thousands per-site hacks. This feature will require thousands more. Who will maintain them, react to design changes, etc?

Can you please make the newsletters visible on PeDMX. thanks

匿名

yes

5 年前

How much is your server bill and what do you use to get more IPs? Secret VPNs and lesser known VIPs? I've found that major cloud providers IPs are often restricted so their scale is not very helpful in that regard.

匿名

There are no many IPs: only my VPSes (they also used for other purposes: DNS, etc, so almost free) + public services like Tor and SoftEther.

I am not ready to buy residential IPs from Luminati-like service to solve issues with Facebook/Instagram. That pays off for ad-traders, but not for a screenshot service.

5 年前

Sorry to bother you, but tumblr has started putting a dumb purple box over their pages: CXXWq, oFqQ4 as examples

匿名

fixed

5 年前

Facebooks redirect to login(.)php, is that a new thing? If success is a rare occurrence, I've been very lucky in the past :)

匿名

They show 1-3 pages per day to a given IP, then redirect to /login.php. This has been the case for several years.

5 年前

Earlier in the week I was able to archive Facebook posts by using the mobile web version of a post/page/profile. Today, when trying to archive a Facebook page, I see the first request goes to login(.)php on facebooks domain and it eventually ends up on a "Not Found (yet?)". I can archive the root page of the mobile version of facebook just fine, but not individual pages any longer. Archive EBUET was one attempt. Known intermittent issue?

匿名

Yes, most Facebook pages got failed, because they redirect to /login.php. Success is a rare exception.

5 年前

Can you point me in the right direction of how you are getting past Bloomberg's captcha? It seems like it's a combination of IP tracing and in browser detection. I tried VPNs but it's just not scalable. Archiveis always works so I am very interested!! Thanks.

匿名

When the archiver gets a captcha, it retries 10 times using different exit IPs. It is enough for some sites (Bloomberg, …) but not enough for others (Facebook, …)

5 年前

can you fix the 403 and also expand the view at archive/ioysB? you can enter something like "main st" in the search to find a sample property to view. thank you!

匿名

Fixed

5 年前

Hi there, Whenever I paste a URL, I get NOT FOUND (YET). I’m mostly trying to archive Threadreader app compilations.

匿名

Can you be more specific?
I see no failures among attempts to save from Threadreader

5 年前

Archiving certain images from /lA8Og doesn't work. For example, if you click on the first image/gif in the thread to enlarge it, and want to archive this URL, it won't load. Seems to be a general problem with i 4cdn org

匿名

fixed

5 年前

Question do you support the popular censorship of alt-right and other incorrect viewpoints and disinformation Internet posts?

匿名

We do not censor “incorrect viewpoints”. Although there are few minor exceptions: for example, Mussolini and Hitler texts are prohibited in Russia and ISIS materials are prohibited in EU, so those pages are geo-blocked (but still available via proxy or Tor). Alt-right content is not problematic at all.

Can you fix /H7qr4 ?

匿名

yes

5 年前

Hi, first thank you for the service you provide. Is it possible to block the cookies for links from this host e.g pQBp9. Unfortunately with cookies only the reduced webpage gets archived. Thank you very much. Do you have any crypto wallet for donations? Best Regards

匿名

Fixed

5 年前

What is the total number of pages it can store? And if it gets full, what will happen next?

匿名

After the Dec 2019 update (the switch from PhantomJS to full Chromium), the bottleneck is not the storage space but computers to run browsers. That limits the number of pages which can be processed daily, so the total number of pages is growing much slowly.

5 年前

Can you bypass the limit on EFe2t?

匿名

yes

5 年前

Can you bypass the registration thing on sPg8Y

匿名

yes

5 年前

How come the queue is always like X000, but my page ends up loading like 2 seconds later anyways?

匿名

Likely, those thousands tasks save from the same website, so they got lower priority

5 年前

Yes, SQWr9 seems to be the same view that the browser would normally use (minus all the shenanigans with reddit messing with the sort order making comparing very difficult). Is it possible that whatever you did there be made the default behaviour? Because it shows more comments, not less, which is of more value, and more importantly mirrors what one sees in the browser.

匿名

removeddit stores those settings in browser’s local storage, so there is no “normal“ but “last used“.

Yes, I set “sorted by: new“ and “show: all comments“ as default. “sorted by: new“ should help with comparisons as it appears to be more stable than “sorted by: top“

5 年前

Hi, regarding the sort order on removeddit, it seems the order than reddit returns comments is probably determined by whatever internal algorithm they use... Regardless, on a removeddit link (not archive) if you click the "show" button and select between "all comments" or "removed and deleted", I noticed it doesn't change the URL. So that means it's impossible to tell archive to "click" this button unless removeddit implements it through the URL?

匿名

Like this http://archive.is/SQWr9 ?

5 年前

Do you know why removeddit links are archived differently than how they appear in-browser. Basically removeddit shows removed/deleted comments, it's used by changing a "reddit" url to "removeddit". Visit a removeddit link in-browser, the "sorted" section sorts by "all comments". However after archiving they only sort by "removed and deleted". This means user-deleted/non-deleted comments don't show up in archive. While not sure if this is a bug, it seems inconsistent? See url ANTOC.

匿名

It looks like there is something at removeddit’s side.

30 minutes after ANTOC and the order is different: https://archive.md/Ai90r

5 年前

Why you're using many hosters?

匿名

To outlive any of them and tolerate events like this

Can you try to remove the consent for FYnjJ and have it point to the actual content?

匿名

yes

5 年前

can you change 10 to 100 or more at IHyXN? the data is pre-fetched. thank you!

匿名

yes

5 年前

So until full text search implemented, there is no practical method of getting older page archives? This is assuming the direct link is lost.

匿名

yes, without full text search, you’ll have to know the direct link to the archive or the original link of the archived page.

What is the links to the "hidden service" page and .onion page of this service (archive is) on Tor?

匿名

archivecaslytosk.onion
archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion

Hello, is there support for archiving DeviantArt pages with an account?

匿名

yes, but there is an issue: it logs out too often

What's the argument for NOT saving all the IP logs for people that access the archives/submitting new archives forever? After all, it just takes up little space on the server itself.

匿名

That’s extra job which brings no value.

5 年前

None of the sites are working? They all just show a gif spinner?

匿名

yes, there was an outage. It works now

5 年前

webtoon has age verification in captures now /9Fp60 ; possible to bypass?

匿名

yes

5 年前

Is your anonymity the only thing preventing the project from being taken down?

匿名

Any website can be taken down as simple as sending a single email (example https://twitter.com/brokep/status/1389314362561777665). I doubt that things like “anonymity“ or “privacy“ can help here.

Is possible to expand all the text of the answers in the archived pages from yahoo answers (in italian and others lang)? It is "leggi tutto" button for each answer.

匿名

examples?

I found some pages with “Mostra altro“ but no “leggi tutto” button

5 年前

Can you please hide the cookie box on 7Kyvd. Thank you

匿名

yes

5 年前

Could you please hide the Cookie-Box on Lfc7W. Thanks

匿名

yes

5 年前

Could you remove the pop-up on dQEAk and press the blue expansion links in brackets?

匿名

yes

5 年前

does your site log image urls when archiving?

匿名

Yes, but only in chromium-based archiver (since December 2019)

5 年前

Could you please remove the popup box on /iMIEj — and then expand the two "SE MERE" ("Betingelser" and "Aftalepart") sections? Thanks.

匿名

yes

5 年前

/pXgW2 Could you expand the "read more" parts of the youtube comments. Some comment pages across youtube contain historical or cultural information that can sometimes be hard to find anywhere else.

匿名

yes, they are preserved, just the height of the comment block is limited.

5 年前

Ever since I started using a VPN, Archive Today makes me do a Captcha. What can I do to avoid always having to prove I'm a human?

匿名

When you are using VPN, you are accessing the Internet from a server address space and look like a crawler.

5 年前

Can you guys add an option that allows us to add our cookies with an archive request, that way we can archive a page that requires user to be logged in? Thanks

匿名

Yes, the idea is nice, it would allow to archive private pages.

How do you see it? “advanced submit” page with extra inputs? Or something better?

5 年前

hello, why can't the website archive instagram posts? I tried plenty of times but in inevitably leads to it saying not found.

匿名

Instagram (and Facebook too) redirects to /login.

The archiver tries few times using different IPs and then gives up.

I need either more IPs or flow of fresh accounts (as they do not live long), it is not cheap :(

5 年前

Can you click on "See All Tech Specs" on Dell deals website archive/bxMyJ ? Thank you so much

匿名

yes

5 年前

can you unblock eightchgaw4nnxcn66nszcgxzzvpjxnlfdv7djaxx5tcw25xlpyfjaqd.onion, the whole site is blocked here

匿名

unblocked (except /lg/ and /lb/)

5 年前

Could you remove HiU2E's popup?

匿名

yes

5 年前

archive/OT406 (compass) -- the links to the units of the building don't work, can you fix at all? thank you so much.

匿名

yes

5 年前

archive/U8hCa (sunroomrentals) -- can you click View all 5 units? thank you!

匿名

yes

5 年前

archive/5yTI6 (compass) -- can you click View More to get the full price list history? thank you.

匿名

yes

5 年前

Who can delete saved pages on here? I just went to a website, to find that my contributions have, once again, been wiped by some $^%@! I KNOW I had saved some pages here, one in particular is GONE! WHY?? What good is it if you also allow content here to be deleted? So who can delete pages on here? How? And how to get them back??? PS: I read your FAQs this was IMDb trivia pages, not anything not allowed. Thanks

匿名

Can you provide more details about the pages you lost? Such claims usually indicate difficulties in finding files (people mistake low-case and upper-case letter or something like that)

5 年前

I know that when you get a complaint from a government agency about something, sometimes you hide archives regionally and sometimes you hide them worldwide. But can you not block entire domain names from being searched/accessed? E.g. there are archives of imageboards in here, and if you try to search for archives, every so often you get no results back and a message saying that a complaint was received from some organization. Does this only happen temporarily while you handle complaints? Thanks

匿名

Just report the domain, I will relax the block.

It happens.

55chan and some imageboards were blocked worldwide. Then people asked why whole websites are blocked, most pages are good. And I switched to regional (or sub-board) block.

5 年前

What's with the occasional blank screen with a gray revolving circle when accessing any of the archive domain mirrors?

匿名

Just wait few seconds. It is “the backend not ready to serve“

5 年前

Unfortunately, saving always ends in a loading loop. Could you please fix this?

匿名

Definitively, not. It might retry up to 10 times if the saved page does not pass the quality check (redirects to /login.php, shows captcha, etc), but it should end. If you feel it “endless”, you are likely observing 5th or 8th attempt, and it will likely fail all 10.

5 年前

The text on /bN5Hr and /VMcw2 is all garbled and unreadable. Can you please fix it?

匿名

What text should be there? It looks broken the same way as on the original website.

5 年前

May you click on down arrow for each tab on /LxUmK. Thanks for your time!

匿名

yes

5 年前

Cloudflare is adding ":80" to your links and desgtroying them.

匿名

Where?

5 年前

/smCU0 Could you please click on the "show more comments" box?

gfair

yes

5 年前

Can you please expand the more details on /aqklP ? Thank you in advance

匿名

yes

5 年前

On /4qA3o, could you please unfold the page? (There's an orange "SEE MORE (39 TITLES)" botton — and once that's hit, there's a new orange botton: "SEE MORE (4 TITLES)".) Thanks!

匿名

yes

5 年前

Any plans to make an account at FurAffinity for archiving purposes? Many pages there require an account to access, and thus over half the site is unarchiveable.

匿名

yes, done

What motivated or prompted you to embark on this great archival project/mission?

匿名

I thought it is obvious: at the time when some event hits the news, the content being discussed is often taken down and that is frustrating. The problem was here back in 2012 and only got worse in the following years.

If I archive a page on social media (e.g facebook) while I'm logged in on my browser, will it show on my snapshot? Or does it always send a logged out page and one of the Archive Today Facebook accounts can log in instead of me?

匿名

Archive Today’s account logs in to many websites. Your credentials are not captured (that would require installing a special browser extension and even that does not work with some websites).

Although we have no Facebook’s and Instagram’s at the moment. Freshly registered accounts got banned too quickly :(

5 年前

When it says "you're in queue", can you safely X out of the page and let it continue to process the archive or will that cancel the process?

匿名

You can safely X out the page, it won’t cancel the process.

But the process might fail, and if you share the link before the process is finished, your correspondent might receive an error message instead of archived page.

5 年前

Is there no longer a LinkedIn login? Thanks!

匿名

It works but not stable: it logs out every few days asking for captcha

5 年前

/qnc5q is unable to display its content, despite that similar posts like /1MY74 has its content fully shown. Can you fix this?

匿名

yes, fixed. it logs out sometimes.

5 年前

/1wHhv is blank, if you have a moment, ty regardless!

匿名

fixed

5 年前

Any big plans for next 1, 5, 10, 50 years?

匿名

I think, full-text search is a must. Independent on Google’s CSE, which has too low coverage (less than 10% of the archive content). The implementation was always postponed, because there always was a risk of losing all the domains and became an .onion-only service, where no-one but me will use the search (and me could afford a hour-long grep), but as it survived for so many years we could predict it will be online at least for the same period of time (https://en.wikipedia.org/wiki/Lindy_effect) and plan new features according to that.

/4J3xx is blank... are you able to bypass that coding? thank you either way!

匿名

yes, fixed

5 年前

Have you thought on contacting Internet Archive about hosting a mirror copy of your whole collection of websites? To clarify, it would be stored as an item, not Wayback Machine pages. What you have is very important! Alternatively, have you thought on offering a torrent of all pages? Thanks for reading!

匿名

It wouldn’t work this way. The storage form is very far from “items“ to upload on FTP or distribute via torrents. It requires computers to run the renderer code which is being changed almost every day (see a lot of “fixed” over here?)

5 年前

Can you remove the "Youtube TV" popup on google cache's of youtube? Example: /REwC3 (The second <tp-yt-paper-dialog> element). Thanks.

匿名

yes

5 年前

/mZeya failed and it seems it fetches 0 bytes on the original page ( news,cri,cn / 20210324 / 6a993ecb-9259-6d68-6e08-50433bcc914e,html ). The original page is working but seems like sometimes it shows a blank page to visitors. Wondering if you can fix it / re-archive, thanks a lot

匿名

fixed

5 年前

archiving facebook does not work why?

匿名

They redirect to /login page and I have no account.

Newly registered accounts get blocked quickly.

5 年前

Can you expand reddit comments? /nisxt#70% Thanks!

匿名

/nisxt expanded what was preserved but still folded

/35Kuv is a newer archive with more aggressive clicking on [+] buttons

5 年前

Could you have it click "Show more" for LinkedIn job listing like b7qVd please? t

匿名

yes

5 年前

The wall street journal article /GfUYD has a wild infinite page length bug.

匿名

fixed

(this looks like a WSJ bug, reproducible in all browsers on https://www.wsj.com/amp/articles/americas-imports-are-stuck-on-ships-floating-just-off-los-angeles-11617183002 after “tap to view“ the page grows infinitely)

5 年前

Is it possible for you to close the pop-up in KZLKb?

匿名

yes

5 年前

Will you do crypto currency donation? I don't want to give paypal money.

匿名

Unlikely. I have nothing to buy with crypto (except one domain registrar, $8/year). The platforms which accept crypto and pay out fiat are unreliable and yet over-bureaucratic, they ask for much more papers than banks. I do not think it is secure to deal with them. One day they “get hacked“ and …

But I agree that the current choice between PayPal and Stripe is too limited.

Is there anyway to fix the formatting on /cyclT?

匿名

yes

5 年前

Can you please remove the popup from /J7guC ?

匿名

yes

5 年前

Is there a way for you to add the ability to snapshot the replies to posts on the gab platform. It is useful to document who is interacting with whom when serious stuff happens on there. Alternatively, is there a way to feed an authentication cookie when taking a snapshot of a page?

匿名

made an account there, it should work now

5 年前

/MRS05 isn't showing the ship's historical path before blocking global trade.

匿名

The problems is the touch event which scrolls casual webpages down and up, here zooms the map in.

You can use https://archive.ph/MRS05/image instead.

For the future, I will add the website to the exception list.

UPD: https://archive.vn/ju7qW is after the fix

5 年前

/8jmja and other recent archives from the same site now seem to have a cookie popup. Is it possible to get rid of that?

匿名

yes

5 年前

/qTGw9 is blank. Also, I seem to have trouble archiving Letterboxd and Wix websites if you have any interest. TYSM!

匿名

Fixed.

5 年前

Bing reddit archive is broken. See ga0HK

匿名

fixed

5 年前

Secondly, don't you have PayPal?

匿名

Yes, the button is on the main page.

I don't think a subscription service is a good idea, since there is a chance that there will be trolls who might find ways around it. Maybe more servers??

匿名

More servers means more expenses up to the point when donations/ad income/subscription will be crucial. Then any interruption (for example, caused by failure of a payment system, as we saw with WireCard and ePayments last year) will put the project at risk. So, growing is difficult, even having the business model and the audience willing to pay.

5 年前

I would pay for a subscription to your service annually. Charging would vastly decrease your server load and allow people who really need your service to benefit from it. Even a modest sub price would cut back on server demand. Just a suggestion.

匿名

That might introduce the shift from saving flashing content (like defaced/hacked websites or manifestos of mass-shooters – here free and anonymous access to the service is important) to serving obsessive collectors (who save page of own home webcam every 5 minutes – and I will not be able to block them if they pay).

I do not want to move in this direction, but yes, there is a space for a companion pay-service.

Could you please unfold the rest of the /Wzq0s page (the black button “Starsze wpisy”)? Thanks.

匿名

No, Wordpress’s infinite scroll is intentionally supressed, even if the “next” button is auto-clicked. Because resulting pages are often too long and heavy, quickly eating all available memory. You have to archive individual pages instead.

Hi... thank you for your help. AO3 no longer unfolds mature content? /mOW32 is this intentional or something that you'd be willing to fix?

匿名

This is a regression bug, fixed.

Thank you for noticing!

5 年前

Hi, is the service down?

匿名

It works for me, but I see significant (~30%) drop in visits. So it may be unreachable from some networks. No idea from where and why

Is the process for creating an archive (.) today snapshot from a live page significantly different from creating a snapshot from a Google cache/ web.(.) archive (.) org snapshot?

匿名

No, it is the same.

But take it mind that there is no single Google Cache. Each Google’s datacenter has its own cache.

You might see a cached version in one country but the archiver might see different version (or 404) because its closest datacenter is different.

5 年前

It seems lately that only one page save is allowed per day. Is that the case? If so, can more frequent saves be allowed again?

匿名

That depends on the webpage. Frequently changed pages (for example main page of a newspaper) can be saved frequently. Static images from i.imgur.com are not. It is to prevent doing useless work saving the same page again and again. Of course, the heuristic rules are not accurate and if you want to save some frequently changed pages with smaller intervals, just let me know.

5 年前

What happened to archive.vn? Everything I saved is just gone?

匿名

I do not know :(

https://blog.archive.today/post/645337228732710912/why-is-there-so-many-different-domains-for-this

Try another domain (archive.today for example)

5 年前

Why is there so many different domains for this project?

匿名

archive-is:

A single domain is vendor lock to its service provider (unreliable and untrusted, which could ’wake up in a bad mood and decided to kick them off the Internet’, there are many such stories). I do not blame anyone, it is just because of the asymmetry: you have only one domain (with too many things depending on it: website, email, authorization on 3rd party services, …) and they have millions clients like you.

Just an hour ago, VinaHost changed nameservers of archive.vn (from “don1.dns.li. ns1.archive.today. carl.archive.is.” to “don11.dns.li. ns11.archive.today. carl1.archive.is.” - note inserting “1“ everywhere), causing downtime of that domain.

What was it? A bug? A hack? A joke? No comments from their side.

Such cases are very common (1-3 times per year for my 7 domains)

What's the browser cookies "_gp" and "cf_clearance" used for?

匿名

`_gp` is not mine, probably one of `top.mail.ru‘s counter

`cf_clearance` is the timestamp when the captcha was solved last time (having this cookie means you have solved the captcha and can show the cookie as the proof)

5 年前

Why is there so many different domains for this project?

匿名

A single domain is vendor lock to its service provider (unreliable and untrusted, which could ’wake up in a bad mood and decided to kick them off the Internet’, there are many such stories). I do not blame anyone, it is just because of the asymmetry: you have only one domain (with too many things depending on it: website, email, authorization on 3rd party services, …) and they have millions clients like you.

Can you add Web Share Target support so that I can easily open an archived page from a mobile browser?

匿名

This?

https://play.google.com/store/apps/details?id=com.navasgroup.share2archive

5 年前

Something's wonky with /EW2KA , it shows just a blank

匿名

Fixed. An interesting case indeed: the archiver answered “yes” to “do you want to download new Adobe Flash“ and the main frame went away to adobe.com

5 年前

Ads on your website? Is this a new thing or just a test run or necessary to sustain the service?

匿名

A test run.

I do not think it will stay (or at least be shown to most of the users), as that eventually will require cookie warnings and other crap.

5 年前

I want to receive the long URL of an archive link and avoid the shortened one. how can I do that?

匿名

There is “share“ button in the header which displays different forms of links

5 年前

Well, in my opinion, I'm pretty sure people prefer looking at the archive without ads. I mean I can understand why you're experimenting with it, but while there will be some people who like it, there will be people who'll disagree. At least in my opinion.

匿名

There are many drive-by users coming from search engines; ads might be shown only to them, etc

5 年前

Noticed you put ads on the archives. Is this gonna be common now?

匿名

just experimenting, let’s see

5 年前

Some archive requests are urgent, and some are not. Perhaps you could add an option to specify? That way, urgent requests could be prioritized, and then it wouldn't be so much of a problem.

匿名

That was implemented many years ago. Batch of similar URLs gets lower priority. There are many rules like that.

5 年前

That "User Abandonment is not the thing to avoid, it is the goal" means you are planning to deprecate or shut down archive-today ?If true, there are plans to publish mirrors and allow us to download the pages we saved?

匿名

I meant, there too many submissions than I can deal with. It results in queue for many hours, so pages the people want to archive get disappeared while their are waiting in the queue. So, unconvinient submission process is the feature, not the bug. Would it be convenient, the waiting time will be infinite.

5 年前

So is fixing this "performance issue" a top priority so that the archivers can avoid being MTIMed by the google captcha again? Or is this like the broken "download zip" function that was going to be fixed "in a few weeks" eight or nine months ago? Have you considered KeyCAPTCHA instead?

匿名

likely, yes.

8000+ elements in the queue is a problem, while captcha paranoia is not. I am not ready to invest neither time nor money in calming people.

User Abandonment is not the thing to avoid, it is the goal

5 年前

Could you please check why archive i32oD (for URL fgw,nmg,gov,cn) failed? The website should open fine. Seems their server is not accepting connections from archive-is

匿名

It is just too slow from outside of China, so the browser window remained blank after 60 second of waiting :(

I retried with bigger timeout

5 年前

I have two questions: #1: It seems as if a captcha is now required for every submission. This is very inconvenient. Can we please have it that one has to "prove" only once, or maybe a few times per day, that we are not robots? And #2, can we please have this add-on for FF mobile? Ever so often when I'm on the road and browsing the web on my phone, I would like to add a site to the archive, but can't since a few months now (since my latest FF upgrade). It used to exist. :(

匿名

1. It is temporary, while there is an unfixed performance issue. And it is valid for 30 minutes.

2. The extensions are not mine, try to contact the author, John Navas. He wrote an Android app too.

5 年前

can you expand -> 9Jw07

匿名

yes

5 年前

Still having problems with really long queue times - literally hours sometimes. Any updates?

匿名

I added more machines with workers. They were able to make captures faster than people submit new tasks.

Few days after, the amount of submissions increased again revealing new bottlenecks - in disk writing throughput and in available RAM.

It seems that simple scaling is not the right way ahead, I have kick off half the submitters somehow (by asking $0.01 per task, or by more complex captcha, …)

5 年前

Any chance you can expand the "+" things at archive/pftiQ (bluefcu: bank/savings)? Thanks.

匿名

yes

5 年前

Could you please remove the cookies pop up box on the following archived pages: /FmESx /nkGCo /p1sMu /rmQRx /7fyz0 /XRBtL /heXOX /SW1uE /pofaG ? Also, could you unfold the “Vis alle afdelinger” button on /SW1uE ? Thank you.

匿名

Fixed locally, will be online with the next deploy (in 3-4 hours)

5 年前

Could you click on the read more in: /XYMZq ?

匿名

There is nothing behind read mode. Even on pages where the button works, it is not an unfold button but an external website link

5 年前

What are your thoughts regarding ipfs? Have you looked into it's viability for your project? What have you determined?

匿名

I think it is possible, but tricky.

Archive’s snapshots are not immutable, you see, there are tons of requests to fix layout or to remove hovering modals. The fixes are applied retroactively. That means IPFS hashes will change over time?

5 年前

Would you be able to unfold Pixiv? for ex. /ha2nH tysm for everything regardless!!!

匿名

yes

5 年前

I think this is wonderful but I worry about authorities shutting you down for political control reasons. Is there: (a) A decentralized un-sinkable peer-swarm version of this service possibly in the works? Or, (b) a FOSS project that would let me roll-my-own archive-dot-personal?

匿名

(a). https://arweave.org/, but they have some sort of pre-moderation, not sure how compatible with political control

https://etched.page/ - archiving pages on bitcoin blockhain

(b). https://github.com/webrecorder

https://github.com/archivebox

5 年前

For some sites like this one /UwUUh it happens, that the scroll while capturing will result in a redirect to the home page. Is there a way to fix this behaviour?

匿名

yes, fixed

There is just a list of websites which must not be scrolled. Probably, need to add some heuristics, as number of such sites is growing quickly.

5 年前

Is it better to ask you to remove cookie pop-ups from previously saved pages, or simply re-archive a page? ex. jyrX3

匿名

yes, removed

5 年前

Hello! Unfortunately, GitHub pages cannot be archived. "Confirm your account recovery settings" page is displayed, instead of the target page's content. Please, fix the problem if possible. Example: archive vn ZTlnr .

匿名

yes

5 年前

Can I save recently removed content that is still available on google cache using archive is?

chanibal

yes

5 年前

Being fair here, have you ever considered partnering with the Internet archive?

匿名

No. I do not understand that culture of declaring “we are partnering with [long list of sound names here]“.

5 年前

Can you remove the 2 popups in /YEsok ??

匿名

yes

5 年前

People often compare various features of archive.is to those of archive.org being mistaken by name similarity (and recently added “save a page” function to archive.org).

This project is different in at least two respects:

1. We have no goal to save the entire Internet. Only manually submitted pages which may be deleted/altered soon. We are about 100x smaller than archive.org in the storage space (700TB vs. 70PB) and expenses (X,000 $/mo vs. X00,000 $/mo).

2. The pages are not saved in their network form. Archive.today launches real browsers (not even headless) and tries to load lazy images, unroll folded content, login into accounts if prompted with login form, remove “subscribe our maillist” modals, … So archive.today is not suitable for making notarized or digitally signed snapshots.

It would be more correct to compare it with other thread unrollers.

Are you able to get around Steam's age gates? Some items in the Steam store and community asks if the user is at least 18 years old, or show a note that says the item may not be suitable for view. Examples (they work differently) - puynZ (need to select an age old enough), pVLfY (confirm that the viewer wants to see the content, by clicking the button)

匿名

yes

5 年前

Can you press the "Read more" button on the togetter (MF80s)?

匿名

yes

5 年前

If someone, purely hypothetically, would have typed in wwwchildporncom (but with the dots) or whatever on the Wayback Machine, not out of any desire to ever actually watch any child porn, but rather out of a desire to see if the Wayback Machine indeed contains child porn--and, if it does, to report this to the relevant government and/or law enforcement authorities--are you going to report this search on the Wayback Machine to either the United States government or anyone else?

匿名

I do not review searches (technically I can, just do not remember me doing that). But keep in mind that the search function is powered by Google, so …

5 年前

How much would it cost to archive YouTube videos? Could you add the option for users to watch ads to pay for it, when they want to archive one?

匿名

I think, archiving videos is not be possible to do.

All video platforms monetize aggressively, not only show ads but have paid subscription, merchants, affiliate programs. And not all are profitable, they also eat investor money.

Their videos people do watch, people’s attention is captured. which is good for monetizing. That would not be achievable on the video archive …but the maintenance costs will be the same.

What are the factors that affect the speed at which an archive snapshot is completed? (Ex: bandwidth, # queries, webpage size)

匿名

Every page is scrolled here and there to get lazy elements loaded, and it is intentionally slow (with human speed) to trigger new lazy loads and not to abort those which might be in progress. So, bandwidth is not the bottleneck here.

It takes 1-2 minutes even with empty queue and simple pages.

5 年前

Can I use this to archve complete videos from youtube and will I be able to access them even if youtube takes them down?

匿名

No. You need “youtube-dl”

5 年前

I have seen on the blog that you are able to expand elements on sites that are broken upon loading. I noticed that archived biographies of the Danish Parliament (ft on the dk TLD) have the content hidden by default, and the accordion expander doesn't work. This renders the archived page almost useless (the content is still there if you view source). Would it be possible to fix the expander or screenshot the page with the CV opened? Thanks in advance. Example broken archive: id BL3Du

ysangkok

yes

5 年前

Can you please expand answers of pt. quora. com? E.g. R629V

匿名

yes

5 年前

Does a tab need to be open in order for the archiving process to continue, or is closing and leaving it fine?

匿名

Closing and leaving is fine, but you have to remember/bookmark the link to get back.

5 年前

Is there an option to disable javascript? One newspaper article is fully visible if I disable JS.

匿名

Yes. Tell me their domain.

5 年前

About that last question, what if there was no list of URLs, just a list of organizations that have requested content removal with the approx number of URLs that were accepted/rejected? sorry if annoying this is my last question on the subject

匿名

That would be the instruction whom to annoy to get the content removed :)

At least two of the law-enforcement agencies (in relatively small countries) do collaborate with commercial reputation services. There were the cases when at first the content (pretty benign, like a post on Reddit) was reported anonymously as controversial, then there was a request from a commercial reputation service, and then the same page appeared in the list from law-enforcers among the child porn.

The top requesters are (the numbers are of whole hidden pages, there are also hundreds of individual images which are difficult to count because most of them are on those pages too):

“`

1668 Federal Service for Supervision in the Sphere of Telecom, Information Technologies and Mass Communications (ROSKOMNADZOR)
1197 EU Internet Referral Unit (EU IRU)
860 L'Office Central de Lutte contre la Criminalité liée aux Technologies de l'Information et de la Communication (OCLCTIC)
195 Bilgi Teknolojileri ve İletişim Kurumu
159 디지털 성범죄 피해자 지원센터
125 Counter Terrorism Internet Referral Unit Metropolitan Police Service
93 The National Center for Missing & Exploited Children (NCMEC)

63 German Federal Criminal Police Office (BKA)

”`

5 年前

Is there a transparency report for regional/worldwide blocks, i.e. a list of or just the number of archived URLs that are blocked in the different regions?

匿名

I do not think it is a good idea, it will cause a storm of new requests against non-fully-blocked pages and also against the list itself.

5 年前

I keep getting the DNS_PROBE_FINISHED_NXDOMAIN error. What should I do? I made sure Chrome was updated and restarted and everything but nothing seems to work.

tokiiku

Are you using Cloudflare DNS (1.1.1.1) ? There is a known problem with it

Is "archive today" operated by the same team than "archive org"?

匿名

No

When will you enable creating YouTube snapshots again?

匿名

I do not know, there are 3.000+ items in the queue even without YouTube and after kicking off seo spammers (there were 50.000+ with them).

If I enable YouTube then the queue will be few days long, because each YouTube page needs 5-10 retries to break through their captcha.

5 年前

When you recieved a takedown request by some agencies, do you just block it only from particular region? Or delete it completly? Do you cooperate with them? Thanks.

匿名

Mostly regional. Child porn is hidden worldwide, the same pages get reported by many regional law-enforcement agencies simultaneously, so I do not wait for requests from all over the world and hide those pages worldwide on the first of the requests.

5 年前

Related to the two anonymous questions about IP logs, do you ever report the IPs who access problematic content to authorities?

匿名

This has not happened yet

5 年前

Hi, could you bypass the disclaimer on /wN2TL and similar?

匿名

yes

5 年前

Can you figure out the reason of getting status 403 on /U7MqZ ?

匿名

Cloudflare’s captcha. Still not passed after trying from 10 IPs

5 年前

Can you please remove the pop-up of /aE7jT?

匿名

yes

5 年前

I've noticed images retroacvitely becoming error messages a few months after a page is captured. Is this normal?

匿名

It is not normal. Any examples?

5 年前

Hi, Archiving is getting extremely slow here in AUstralia, I am in like 5000 in queue, how do i solve this problem? thanks!

匿名

I think, prohibiting to archive Youtube will help.

It does not work anyway: Youtube shows captcha forcing the archiver to retry 10 times which is very slow and fruitless.

5 年前

I got an error 500 on /1XdWa. Is it possible to fix this?

匿名

It is error 500 from WCJ, not ours.

But it seems that WCJ responds with this error page quite often, so I will retry automatically on receiving such responses.

5 年前

What is your policy on objectionable content? For example website that contains hate speech, racism, calls for violence, conspiracy theories, etc. All objectionable, but still worthy of saving to study (for example research to counter hate speech), or just for the sake of it? I've read scientific studies that cite such content, but when you click the link it's been deleted. Or, comments posted online are interesting, but where they are posted is objectionable: on adult video/piracy sites?

匿名

Generally, OK.

It does not imply that we support hate speech, fake news and similar stuff, as the archived content can be used in various ways: not only to express radical views, but also to study, to cite, or even to make police investigations against those speakers.

By requests from the authorities we hide only ISIS-propaganda (only for visitors from the countries where ISIS is forbidden) and some classical texts (by Mussolini, etc) which are still forbidden in some countries.

Deletion requests from Fa- or Antifa- groups are ignored.

Can you fix the GDPR popup on /lkfpu ? Thank you

gfair

yes, fixed

5 年前

Why are no pages loading at all at this point, after multiple days of incredibly slow service? Very slow loading times (or archiving attempts that end up aborting) aren't new, but this is the first time I've ever seen it where every single page either gives an error or every save attempt gets stuck on the "submit" loop.

匿名

It happens with YouTube pages last few days: they show captcha to our IPs, so the archiver retries many times

5 年前

About Anonymous' question of deleting logs, You said "logs are deleted" and "But it can be recovered". How is it possible? Then can you permanently save and recover users' logs? Thanks.

匿名

The information about problematic content and which IPs accessed it can be recovered from not-yet-deleted logs.

5 年前

I'm trying to use a collective annotator (hypothesis) for my environmental econ course at Colgate University. When I try to link the hypothesis overlay to your site, I can't proceed past the captcha page. Can you disable the captcha for instances like this?

匿名

yes, fixed

Is there a privacy policy for the user's data collected? I am wondering if I clicked on an archive link, and if the link contains problematic information, will be IP address and log data be reported? Still unsure about how archive works, thanks.

匿名

Of course, the web server produces logs.

There is no long term storage (logs are deleted when there is not enough space on the disk local to the webserver, so the retention is about 1-2 months) and no real-time analysis of what information is problematic. But it can be recovered.

5 年前

Would Archive today capture Facebook comment, for example /EUby5?

匿名

Fixed for some time. Facebook is constantly changing their layout so expanding comments stops working every few months :(

5 年前

"archivecaslytosk dot onion" is a v2 onion address which is being deprecated and will stop working this year. Please make plans to generate a v3 onion address and publish it on your v2 site so those of us using it can make the transition to your v3 onion address. Thanks so much for your service!

匿名

There is v3 if you prefer

archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion

But v3 is not yet stable, it is prone to ddos attacks against the whole infrastructure (https://twitter.com/DarkDotFail/status/1348444759082192897), so I am not so optimistic about deprecation and transition.

5 年前

Would you please remove the login in popup on /yjywx. Thanks.

匿名

yes

5 年前

Why is archive is inaccessible from Turkey? I can't access without VPN.

匿名

I do not know. Turkey’s share in total traffic is three times less compared to a year ago. It declines steady, there is no step on the chart that could be on the day of the government block.

5 年前

Can I archive something i see on youtube?

匿名

Only appearance of the page: images and comments, not the video

5 年前

Hey, I am trying to archive a ‘subscribers only’ page, is there any way to do this?

匿名

It works for some websites which show the pages and then hover them with “subscribers only“ popup. If there is nothing under “subscribers only“ then there is no way to do.

5 年前

If a major conflict or war started in any G20 country, could you consider opening the gates a bit? Things would be changing very quickly and future historians could benefit from your project. I'm already solving close to 100 captchas a day and I know if things hit the fan I would be pulling all nighters trying to save important information.

匿名

The capacity is limited and captcha is there to allow more people on board (especially those who need to save 1-2 pages urgently). Obsessively solving catchas just increases the queue to many hours of waiting, and the content might disappear during the waiting.

For mass-archiving it would be better if you install something (for example https://archivebox.io/) on your own server.

5 年前

On pages that have timestamps in them for example social media posts, it would help if the archived page had information on the geographical location or time zone of the chrome browser that archived the page. I know the archive(.)is header has the timestamp in UTC but it isn't always clear what timezone the page used.

gfair

The browsers are running on my servers, they have UTC as computer time and geographical locations is almost random (many pages are accesses via Tor exits)

5 年前

The date in history is wrong for /vOE48 it's not the original date from wayback machine

匿名

fixed

thank you for the report!

5 年前

Want donate anonymously ( Bitcoin )

匿名

Thank you but this is unnecessary.

There are almost no bills which could be paid in bitcoin and we do not want to deal with scam exchanges who collect biometric data and then “got hacked“. The best thing to do is to donate the coins further and that you can do directly.

What for the donor is anonymity, for the recipient is the risk of identity theft (following hijacking of the domains, etc)

5 年前

But the link is showed at first and it wasn't fast enough to be saved before the redirect works. /oKRwK

匿名

ah, indeed. fixed

5 年前

The SCMP /C020A has a overflow, which has blurred and hidden lower part of the page. Could you remove the blurunhid the part.

匿名

yes

5 年前

Would you please remove the log-in popup on Shimo (/xua5W)

匿名

yes

5 年前

Can you avoid save the redirect in sites like this one? /oKRwK

匿名

No, it requires a paid account on that website to view the page

5 年前

Please help remove the dark-green popup on Reuters (/86UCw).

匿名

yes

5 年前

Thanks for you previous work. Would Archive expand the Douban post on /5cIcd, as there are some content hidden behind the ellipsis(...).

匿名

yes

5 年前

The Weibo (on archive /iVrEF) has 5 pictures, is there a way to capture all the 5 pictures or make a long picture?

匿名

yes. they have been captured, only invisible behind the first image

5 年前

What are things to threaten (insufficiency of money, capacity of the server etc) the persistence of archive today?

匿名

The deplatforming wave might hit us too, but it is ok for now.

5 年前

Whould Archive remove the popup (with Chrome and a blue Zhihu logo on it) in webpage /UzfyD , thanks.

匿名

yes

5 年前

Would Archive automatically expand a Sohu News webpage (a orange download arrow reading "展开全文/Expand the whole page"), For example /SCbqi

匿名

yes

5 年前

What's up with the recaptchas i get Attention Required the whole time and it's so annoying

匿名

There was 5000+ (and growing) items in the queue, so I made the captcha stricter to give chance to those who are more motivated. The queue is almost empty, so the old rules will be back in place in few minutes.

5 年前

The following question, would Archive automaticaly expand webpage /XcIH4 (a Douban group post).

匿名

yes

5 年前

Archiving images from 4chan doesn't work anymore. Formerly: archive-is/offset=2500/is2-4chan-org Now: archive-is/is2-4chan-org (insert a "." instead of the "-" to make the link work). Is it possible to fix this ?

匿名

Yes, this is my bug. Thank you for the report. I will rearchive the failed images. Unfortunately, many of them are 404 now :(

5 年前

There seems to be an issue with archiving social media website Parler. The process keeps retrying until it ultimately fails. I noticed it happens with archiving a single image but happens with posts too, and it seems to apply to everything on that website. ... /Sbiml is the one I have problems with, if you need the debug logs. I noticed it gives status 304 during the process, then fails. (The page link can be found at /edeDd under "Original", if you are unable to see it from /Sbiml)

匿名

Ironically, it is one of the heaviest media sites (12Mb javascript, etc), so its archiving often fails. I made a few fixes, it should work better now.

Hi, there seems to be a bug with archiving links in Twitter posts on their mobile site (ETTo9 & U2cPS). It seems to be working fine on the desktop site (uaydR).

匿名

Twitter “old“ interface is what is shows to GoogleBot.

It lacks some elements: embeds or censorship warnings, but allows to capute more texts without hitting “too many requests“ error

5 年前

Could you please fix this capture so that it clicks on "Story Continues" button? /mr8cg

匿名

yes

5 年前

Have you been able to link spikes in traffic to your site with political events? I am curious if recent news out of the USA is causing the archive queue to be full

匿名

There is no spike in visitors. Queue is longer than usual, but most of the items are not related to the USA news.

5 年前

Hi ! I have a time-sensitive request. Would you be able to manually archive Trump's twitter homepage, for just once, using twitter's NEW interface? Link available at /CgSLO and others, but one-time only. The new interface will display a special notice which does not show on the old interface. Thanks in advance!

匿名

http://archive.today/cEfsa

5 年前

Is there a bookmarklet still? I can't find it anywhere

匿名

javascript:void(open(’http://archive.today/?run=1&url=’+encodeURIComponent(document.location)))

It was replaced by browser extension, as many people do not understand how to install the bookmarklet. But it still works.

5 年前

How much does running an archive like this cost? Does this project have any end of life plans such as transferring the archives to other locations should money become a problem.

匿名

Money shortage is unlikely. (even if that happens, plan A is to add paid accounts with premium features, plan B is ads).

5 年前

None of the onion sites archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd DOT onion archivecaslytosk DOT onion work when I click "save". Tor Browser gives "Warning: Potential Security Risk Ahead". Please do not use invalid self-signed certificates. Picture 1: is DOT gd/PvVYgt Picture 2: is DOT gd/69yIG4 Picture 3: is DOT gd/PqaKIC Picture 4: is DOT gd/KZdj3h Thank you!

匿名

Do not expect https on .onion sites because the certificates are not widely available. Only Facebook and New York Times have them.

5 年前

Is there a possibility of posting a log of requests so people can easily reference what's important at the moment? It would be so valuable to people monitoring freedom on the internet.

匿名

http://archive.is/rss

5 年前

Do you happen to know of any events where a page that was archived was removed afterwards? Just curious, haven't experienced this issue myself but have heard it happened a couple times in the past.

匿名

There are 2 cases:

1. some pages are removed by authority requests. Metadata and the name of authority are still there (example https://archive.is/6t3I2)

2. sometimes people share links when the archiving process is not yet complete. if the process fails (for numerous reasons: from browser crash because of too long page to permanent redirect to /login.php), then there will be “Not Found“ page without any metadata or explication. I should keep and display info about such failures, but it is not done yet and it might be perceived as mystical disappearance.

Could you have the crawler click "I Agree" on /2ZSFG and similar? Thanks

匿名

done

5 年前

can a long comic strip from to to the bottom frame say like the size would be 1000 x 8000 and when years goes by and the image is gone in all, except for the screenshot but when clicking the comic stripe that wasn't there anymore can it still be there for a up close zoom in?

匿名

example?

5 年前

Is it possible to archive a paywalled web page if I personally have a subscription and can see the whole page?

匿名

It is technically doable (via browser extension), but currently not implemented.

5 年前

Any way to get around this "403 Geo-block"? /zKtH7

匿名

fixed

5 年前

Do you still accept Liberapay?

匿名

yes

https://liberapay.com/archiveis/donate

5 年前

Hi, this page has saved with an overlay -- qQ2sB -- and I wonder if it's unavoidable or possible to remove it? Many thanks :)

匿名

yes

5 年前

Hi, you asked for examples of the Google cache date not being shown. For testing purposes I made some more captures, and it did not work for any of them. An example of the date detection working is /3FgOV (en) from December 2019 (referring to the text that says "29 Nov 2019 16:23:10 UTC"). It did not work for /wwM9w (ja), /mP6YV (nl), /b6LND (zh-TW), /eb5O1 (zh-TW), /r3p2o (ru), /GXpgs (ru), /AoH7W (en), /Of2lj (ru), /eV1Lm (nl) or /g1lMK (ru). The functionality was useful so I hope it returns.

匿名

Yes, it seems that html of the header has been changed, so the code which parses the timestamps out has to be fixed.

I will do it in few days.

5 年前

Intermittently I get "DNS_PROBE_FINISHED_NXDOMAIN" for archive-is on Rostelecom (Russia) +Google DNS, while archive-md works at the same time. What could that be, some issues with local russian censoring?

匿名

Yes, that’s Roskomnadzor.

archive.today should work and redirect to one of the mirrors which are not blocked.

5 年前

Additionally, results are also different between a URL with "www" and another without it.

匿名

Here too, the domains are different, but mostly used as aliases nowadays.

I recall, when social websites gave 3rd level domain to the users (like $username.domain.com), it could happen that “www” was a username.

5 年前

Why is there difference between a URL ending with slash and another not ending?

匿名

Yes, technically, they are different and could have different content.

They are the same only on some CMS (Wordpress, etc).

On other CMS “.html” ending is meaningless.

5 年前

i would like to archive a weppage that has been archived at an earlier date but has since been updated by removing earlier (still relevant?) text content completely and inserting new text content to the article. My question is if i archive the earlier, already archived page, is the process to delete and replace or is it added as a revised updated page leaving the earlier achived page available for comparison as these changes may be important? i hope i am asking my question clearly lol. thank you

匿名

Already archived page won’t be replaced. There will be 2 pages available for comparison.

Can you please fix the presentation of these snapshots?: /xYPR3 /AhTUU

匿名

done

5 年前

Could you exclude the banners of "ご購入案内"(purchase guide) on www．yomiuri．co．jp ?

匿名

fixed

5 年前

Why am I now seeing everything in Russian vs English?

匿名

where?

5 年前

does your site save all pages that people post? Does your site remove previously saved pages, if later, the administrators decide that the previously saved material is objectionable, or might be fake news? I've seen material removed from other archive sites, is why I'm asking.

匿名

Some ISIS propaganda and news are removed due to Europol requests (still available on .onion). Fake news are kept. What today is fake news could be true news tomorrow and not news the next day.

5 年前

hstspreload(.)org Can you activate HSTS on your services? It helps to pre-load your sites using HTTPS.

匿名

No. It is not a HTTPS-only website.

5 年前

Can you please implement a feature similar to "Save outlinks" of Wayback Machine?

匿名

No. Saving pages here is much more heavier process than on Wayback Machine. Here it runs Chrome, executes JavaScript, scrolls page down and up, while on WB it is just a curl download.

5 年前

Pastebin used to allow archiving of the site, but recent changes mean that any time I attempt to save a pastebin, now archive only saves a warning page: "Pastebin’s SMART filters have detected potentially offensive or questionable content ahead. The content you are about to view has been deemed potentially offensive or questionable by our filters, because of this, you’re receiving this warning. You can continue ahead at your own risk or go back." Even when it's SFW. Can this be gotten around?

匿名

Sure

5 年前

Is there a way to programmatically check if there is an archived version of {url} at archive(.)is/newest/{url} My usecase is when a source site is unavailable I want to show my users possible archived versions. With wayback machine I can check some json if there's something there before showing my users a link, but on archive(.)is the best I can do is always send them the link. Then since often there is nothing archived here yet, users get trained to not click the archive(.)is link.

匿名

https://archive.is/timemap/http://www.w3.org/ for plain text answer

It looks like there is JSON-answers in a newer standard (http://timetravel.mementoweb.org/guide/api/), but I was not aware of the newer version and no one has complained yet (since 2015) that it does not work.

Hi, I have noticed that sometimes the date shown for a Google cache will not be detected. Would you be able to fix that?

匿名

Examples?

5 年前

The archiver will scroll down to archive a page. Could it also scroll up a bit first before scrolling back down? Sometimes pages load to an anchor and the content above it is lazy loaded. Thank you

匿名

Could you provide the examples?

Actually, it scrolls up at the end (mainly to fix title and location which depend on scroll position on some websites).

5 年前

Two years ago Google stopped allowing for apps to use domain fronting with their site. I noticed an interesting redirect during the saving of /3ZAo1 it had the url of "sorry/index" and I think this could be a new way of proxying urls. Could you provide that entire url string?

匿名

“sorry/index” is the url where Google shows “too many requests“ error. That snapshot has been dropped and a new one was made using another exit IP.

5 年前

Sometimes I get a bad archive due to the page saving from a region that the site is inaccessible from. This usually results in me waiting 20-30mins to archive the page again to see if I can get a better archive. Sometimes I have to repeat this many times before I finally get a good archive. Is there a way I can request the archive from a specific region? A param perhaps? I hate causing the extra unnecessary load on your resources.

匿名

There is no way to specify exit IP. There is a database of domains and rules (like “this website requires USA IP“ or “non-EU IP“ or something). Drop me an email with the websites which need this special handling but not in the database yet and I will add them, and it will fix experience for you and all other people who archive those websites

5 年前

What is the long-term future of the project? Would you ever considering providing an NGO (that aligns with your credo) a copy to provide data warehousing to assist with historians and digital anthropologists?

匿名

I think, CommonCrawl project suits their needs better: it has much more data and possibility to query the whole dataset using cloud tools. As it appears from our experience (and looking at the increasing censorship), keeping the pages online is more demanded than assuring that “everything is backed up to the tapes but not accessible online”.

Hello i noticed that /01Cle has an issue where the images and page content lazy loads after the interstitial is clicked. If you have a chance, could you look into it? Thank you

匿名

yes, fixed.

Thank you for the report!

5 年前

Facebook non-verified/non-public figure/non-corporation pages seem to always fail to archive for a few months now, even on pages you don't need to be logged in to view. It seems to try to re-archive it a few times, sometimes the first link redirects to /login/, but it still fails even if it doesn't redirect to /login/. Here's an example of someone in the news recently: archive/sqpQA (Not Found (yet?)) or just try to archive any random non-public figure account.

匿名

The archiver tries 10 times using different IPs, if it redirects to /login/ all 10 times it fails. It is possible that 11th will success, their redirect to /login/ is not stable (the same for Instagram. Retries usually help for Instagram, while for Facebook 10 redirects in a row is quite common)

You do an amazing job. Are you receiving enough donations? The amount you are receiving on librepay does not seem proportional to your value! Are you using any other donation platforms? Also, are you keen to gain more popularity, or will that bring with it too many problems?

匿名

Not enough, but it is ok. There is almost no problems to throw money at. Yes, it is possible to buy more disks or servers for full-text search, but that would reduce mobility: all the datacenters (ranging from Google Cloud to “free speech“ Epik) either cut the wires or, realizing than we need months to move out, tried to triple the prices. I do not think it is the right way to burn the donations (or to start replicating their business games by introducing accounts and then asking money from the users to get access to). Likely, the popularity/expenses equilibrium will remain the same.

5 年前

Two things. Sometimes I notice upwards of 10-20k requests in the queue, but then the site still responds very quickly after one refresh. Is that real or is it a bug? Second, our favorite Voat archiver, @derram, claims he is blocked. Is it possible to revert this block? We really miss him.

匿名

The queue is not linear, for example if there is 5k urls from Twitter and 5k urls from Reddit in the queue, they will be taken in interleaving order (one from R, then one from T, then one from R, …). Those 10-20k are usually from the same website, so any other url goes right in.

There is no account to block. He might hit captcha to often which prevents him working? Drop me an email, we’ll try to whitelist

5 年前

As an example, I tried archiving the following Facebook post (it's in Italian, but it shouldn't be an issue): www facebook com/orgoglionerdnetwork/posts/3794494357235763. While the post is archived successfully at archive is/kKrZW, comments (which are public) are not displayed. It would be great to archive comments (and replies) as well.

匿名

Fixed (the fix should work with new submissions as well)

5 年前

I love archiving government sites. They often change things trying to gaslight us. Something I noticed is sometimes when they are required by law to make something available online, they will have a typo or error in the URL so clicking on the link doesn't help. A sort of malicious-compliance if you will. /dSIE1 is an example of this. However I don't remember what URL that archive was suppose to point to. Could you please update your "Not Found (yet?)" pages to more info? Like date-time and URL?

匿名

https://ucr.fbi.gov/hate-crime/2019

It is asking for username/password and thus has been failed

Is the decision to not support archiving of video a technology limitation or a legal one? With the growing capacity and decreasing cost of modern storage, do you foresee a point in the future where modern online archive systems will support arching of video or is this off the table for the foreseeable future?

匿名

Actually, I do not know. I am not an avid video consumer so had very little interest in video technology and culture.

5 年前

What is Archive today backend infrastructure like? Do you throw everything onto one server or do something more complex such as backup to multiple data centers or have offline tape backups?

匿名

two datacenters, no tapes.

5 年前

Would it be possible to make twitter pages more interactive/"flesh them out" more? When you archive a page today it only captures a few of the replies and does not allow you to expand to read more.

匿名

The problem with Twitter is too many people do archive tweets so scrolling down and expanding folded comments quickly ends up with “too many requests“ from Twitter. It is only question of having many fresh proxies and fresh accounts.

5 年前

Currently the archived site shows a sample of sites that are linked to it, if they exist. What are your thoughts about providing a graph view showing in addition the outgoing links that also currently are in the archive?

匿名

There is full graph index under the hood, but is not well optimized for a public product (some queries took minutes to complete)

5 年前

I found that the image archiving does not work properly. A site which I saved earlier, was removed, and now the archived version has no images anymore, just large white space where the images should be. It would be great if you could overhaul this to make sure you actually copy the images. Also, please allow links to your archive website, so I can illustrate the problem.

匿名

Images (especially big ones) sometimes loading too slow. Try to refresh the page.

5 年前

Hello I am not sure what happened during the archiving of /ayOoI the "Saved from" and "Redirected from" seem to be wrong. At the time of archiving, both of those links did not redirect anywhere when I tested them locally. And during archiving the network traffic report did seem to show any redirection. But as I type this, I realize that maybe this was caused by an infinite scroll changing the url during scrape?

匿名

Yes, technically there is no redirect on scrolling, only change the string in location bar. So “Redirected from” here is the requested URL and “Saved from“ is what was shown in location bar after a couple of PageDown keypresses.

5 年前

doesn't dnssec solves the second issue? and for the first one doesn't it provide better privacy for the visitor?

匿名

Yes, when you are using a DNSSEC-validating resolver on your premises, you do not need Cloudflare DNS. No, when you are using Cloudflare DNS, you delegate DNSSEC validating to them.

My point was, when you start your internet journey with sending a request to Cloudflare DNS, you might get into a forked internet: resolver might return a fake IP on which there will be a copy of (or mitmproxy to) any website with a valid SSL.

So you have to trust a single actor (an US commercial company, btw) for not to behave mad or being hacked or subpoened or to add Brave-style monetization with inserting ads to the pages.

I’d say it is too big a price for improving privacy.

5 年前

when will your site be accessible from cloudflare dns?

匿名

Likely, never.

It is too dangerous a thing, both for the webmasters (as we cannot see the region DNS requests are sent from) and for the surfers (as the same entity which answers your DNS queries is able to issue SSL certs for any domain, so using CloudFlare DNS you never know whether you access the original website or a fishing one).

will you accept bitcoin donations?

匿名

No

5 年前

how do I see an article that requires me to subscribe first?

匿名

This feature is not implemented yet

5 年前

Can you maybe fix the popup ad in some old pages like xM8IM? TY

匿名

yes

5 年前

When archiving a Facebook post, it'd be nice if comments got archived as well. Is there any way of archiving all comments when archiving a Facebook post?

匿名

Please provide examples. The buttons like “show more comments” have to be clicked but they constantly change design.

5 年前

can you fix suruga-ya(.)jp links so they are saved from a Japanese IP address? used to work anywhere but now they block international IPs starting today...

匿名

No, Japanese IP did not help. Probably, a Japanese residential IP would help but I have no one

5 年前

The content of /uRXY9 cannot be seen at all, and there's the cookie message, plz fix it

匿名

fixed

5 年前

Why some YouTube pages only have their thumbnails or even absolutely nothing archived? For example: EEWsL, TFglP, rljfc, wuSH8

匿名

Because I have to use proxies accessing websites like Youtube, Google, Twitter, which limit number of accesses from an IP address. And proxies slow down the internet connection up to such results :(

5 年前

Could you please expand the frame size of sites like /xPZMO ? Thank you

匿名

yes, sure

5 年前

If the bad guys were to unexpectedly shut down one of your two data centers how long would it take before a second data center would be back online?

匿名

They are both online, normally balancing the load. When one is off for maintenance, the website works slow.

5 年前

Considering the old successful story of reddit's "give gold to support our server uptime" scheme was in fundraising (granted in their case it turned into a giant scam). But I think the "fundraising progress meter" they used to publicly report on their daily money goals was very effective. It gave a community feel to giving gold. Almost like it was a collective responsibility to keep reddit ad-free by donating to the common good. Have you considered having a daily donation progress bar as well?

匿名

“daily” is overoptimistic, most days there are zero :)

5 年前

/8rpYA and simular pages from the same parent domain is an interesting case where the archived page is actually an IFrame of a another news page. What do you think is the best way to archive this? Would it be a good idea to log it as a redirect and just follow the page to the iFramed page? Thus Removing the Frame? Or would the archive still work and be more accurate leaving the IFrame?

匿名

I removed CSS which limited the height of the iframe (only for this site). Is it better now?

5 年前

About: /post/632648485201739776/ - Thanks again!! Could you apply this rule to all new URLs on this portal or do you only fix specific archives?

匿名

It will be applied to all new URLs after next deployment (later today or tomorrow)

5 年前

In Idealista (leading apartment search website in Spain), can you fix "Leer comentario completo" (read full comment) and "fotos siguientes" (see next photos)? Thanks! /VeJYf

匿名

fixed

5 年前

is it 1999? asking because you block access to browsers & I haven't seen this retarded shit in decades. you block browsers that are identical to ones you've listed as supported

匿名

If you are about Brave, I agree that adding ads to the pages and replacing ref.links is very 1999′ish. It was called ActiveX malware back then.

5 年前

Every URL I archive and have archived is blocked by copyright. Why? If I archive with VPN it doesn't get blocked but if I don't use VPN or another IP address it gets blocked. Did I request too much URL's? It says: "In response to a request we received from 'US Digital Millennium Copyright Act' the page is not currently available.If you need it for research, investigation or other purposes, please, inquiry via email, or Search this page in Google Cache Поискать эту страницу в Архив.Орг Search t"

匿名

There could be a bug. What website are you trying to archive?

5 年前

Can you remove the blocking/login panel that appears on Facebook pages when you are not logged in? It shows up on /4EG79 but not /lHNEb and seems to appear when a person scrolls down the page. Thanks!

匿名

4EG79 is saved from Archive.org, not from Facebook. It is dangerous to click on buttons “Not now”, “Hide popup”, … Archive.org snapshots, likely they won’t work as intended. On contrary, lHNEb is saved from Facebook and “Not now” has been clicked.

5 年前

How much space Is left in archive. is servers?

匿名

Not to much. I plan to change data duplication to erasure coding to use space more efficiently.

5 年前

Sometimes it can be important to capture in the archive the original url that the archived page was redirected from. I noticed that you have this feature, thank you. Sometimes the redirect can be several urls before landing on the page that needs to be archived. I ask do you capture the middle redirects? And if so, how urls of the redirect chain do you record? Is it all of them?

匿名

Yes, new archiver (which works since Dec 2019) records a bit more than the old one, that includes all URLs of intermediate redirects, all URLs of images and scripts, HTTP headers, IP addresses of the servers, etc. I had the idea to visualize it, probably in a form like “Network” tab of Browser’s DevTool. And to use that info to improve adblocker.

5 年前

When an link in an archived page is clicked, it is checked to see if it has also been archived. If so, then the archived page loads, if not then the real url loads. But what if there are three archived versions of that archived out-link page: the out-link with a timestamp one day before the originating page, one with a timestamp one week after, and one with the most latest archive. How do you determine which version to link to?

匿名

With the closest timestamp to the snapshot you are currently on.

There are also <-prior and next-> buttons to navigate in time in case of multiple versions.

5 年前

I read in your FAQ that you keep the images at 2x duplication and textual information at 3x. With many websites using the same JavaScript libraries how do you deal with storing commonly referenced libraries say JQuery? Do you use pointers to save on space?

匿名

JavaScript libraries are not stored, they are executed at the time of capturing and the result of the execution is archived.

Commonly referenced blobs like background images and fonts are deduplicated, yes.

5 年前

Does it archive entire social media accounts, like a person's Twitter account, or just specific posts?

匿名

just specific posts

5 年前

Are Wayback Machine links no longer allowed to be backed up in your archive? The archive process seems to keep rejecting them.

匿名

There is an issue with Wayback Machine snapshots which are just saved to Wayback Machine.

There seems to be some sort of eventually consistent storage, so if you just saved a link to Wayback Machine and immediately send the WM link to a friend (or feed in to Archive.Today), they might see an empty page on WM. In 10-30 minutes the WM page is visible to everyone

Can Archive Today have long screenshot of the whole webpage like that of Internet Archive?

匿名

No, it would double the costs.

5 年前

The new Twitter keeps showing up in new archive saves now. Is there anyway to revert back to the old Twitter for new archives or did Twitter just permanently kill off their old site design?

匿名

Yes, but old Twitter (or what is left from it) does not show tweets which are marked as “sensitive content“. Apparently, because now it is tailored only for GoogleBot, not for humans

5 年前

is neo-nazi material permitted?

匿名

I think, yes, although I am not sure about the future.

So far, the materials which attract the most govt (or quasi-govt) takedown requests are:

* child porn (from NCMEC, OCLCTIC, ECO.DE, JUGENDSCHUTZ.NET, IHBARWEB, CYBERTIP.CA, MELDPUNT, PAPS.JP, IWF.ORG.UK, HOTLINE.IE, …)

* ISIS propaganda (from CTIRU and EUROPOL)

* Cookbooks for drugs and explosives (mainly from ROSKOMNADZOR)

5 年前

Sites archived via google as a proxy (using the I'm feeling lucky link) are hit with a redirect interstitial page. /IGtuE

匿名

Fixed

5 年前

Why I still have to do captcha in your onion site? And why the tor browser says my connection to your onion site is insecure and your certificate is not trusted because it's self-signed, once I try to archive or search any page?

匿名

There is no easy way to obtain a browser-trusted certificate for .onion domain. As far as I know, there are only 2 .onion sites with valid certificate: Facebook and New York Times.

Anyway, it is merely a show off and it has nothing to do with “secure“: when you visit .onion websites, traffic is unencrypted only between the browser and Tor service running on the same computer, so plain http is OK.

5 年前

is it possible to save all pages of a blog?

匿名

No

5 年前

The "click here to learn more" dropdown sliders do not seem to translate functionality to the archive page. /vusQc

匿名

Fixed

5 年前

Hi, the explore trending pages of twitter are not archiving correctly: /8B8CQ Thank you

匿名

Fixed

5 年前

Hi, what does the GDPR and 'Right to be Forgotten' have to do with Archive(is) and Icelands - ISNIC? I saw it discussed in a tweet.

匿名

This https://twitter.com/isnic/status/1082257946631987200 ?

I have no idea, ask them.

5 年前

Here's an example for the reddit gallery issue: archive(DOT)is/WRs8D If these images were uploaded in separate posts, they would be saved in full size or would let you click on the image that could then be archived as full size. At the moment, only the thumbnails are archived and there is no way to archive the full sized image (especially an issue when trying to archive reddit posts with multiple screencaps of text).

匿名

Big images are actually archived too, but it seems difficult to show them in a flat snapshot.

Making snapshots interactive (to show full images on click or on hover) might be s solution, yes.

5 年前

Thank you for all that you do. I noticed that embedded tweets sometimes aren't showing up. Example: /j6R5w I don't know if this can be fixed.

匿名

Hm, there is nothing to prevent archiving embedded tweets. I retry and it helps.

Probably, there was bad connectivity to Twitter. Or they temporarily banned my IP.

5 年前

When archiving reddit posts with image galleries, as opposed to posts with single images, the archive only saves tiny thumbnails as opposed to either saving or linking to the full sized images. Is there anyway to improve that?

匿名

Examples?

5 年前

Have you thought about publishing a "Chillingeffects" style list of all the items removed from the archive? Future researchers might find this useful information to know, especially when studying what information authoritarian regimes didn't like to see in the public record.

匿名

I used to submit those requests to Chillingeffects until they stopped to work with 3rd party websites few years ago.
Then I made a page on GitHub Pages which immediately became target of removal requests which GitHub executed.
As for now, Chillingeffects removed many requests it once published and almost all websites which once had such a page do not have it now.
Removal requests themselves is one of the most toxic content on the Internet :(

As for government requests, there is very little number of them.
The vast majority of requests is from Roskomnadzor (Russian Govt) bot which is looking for drug-related pages and sends tons of requests.
Those pages are hidden only in their region and still available via proxy and on .onion archive.

Is it possible to get rid of the country popup and grey overlay on Newegg USA website (happens from non-USA IP)? Example - WQJfg. Not sure if it will help but it seems like: Grey background overlay - div class "ReactModal__Overlay ReactModal__Overlay--after-open"; country popup - div class "centerPopup-body". You may have a more efficient way of dealing with them, though. I also noted the grey background on homepage has a different div class. Hope this makes sense and thanks very much!

匿名

Yes, they changed class names so the fix has to be adjusted. I will deploy the fix in 1-2 hours.

5 年前

Is your service down right now? I am getting a bunch of 503 and 504 errors. Do you happen to have a status page? Thank you

匿名

Crashed with “out of memory”. it should work now

5 年前

Can I archive a post in a private facebook group?

匿名

Currently, not. i will implement this feature soon.

5 年前

Do you have a way (google form, etc) for us to let you know about a bot we have created? I was thinking that you might want to know the ip address of our reddit bot.

匿名

email?

5 年前

right now, archiving links is taking hours. what's going on?

匿名

Actually, not.

High numbers displayed as current queue length is not an issue - it includes bot-submitted tasks which have lower priority

Can we give you our subscription to newspapers or magazines like newscientist so we can archive premium content?

匿名

I think I will add a possibility to provide cookies along with the URL.

That would allow to archive pages as they seen by a logged in user. It is mainly to address issues with archiving social networks, but it should solve your task as well.

5 年前

Increasingly, gaslighting is used by governments to protect control of their country and media. Today a slip of the tongue (fingers, as it was a press release) reveled a plot by members of the US government to stage a coup later in the year. Luckily google cache was used as evidence to show to the public that this did happen. I imagine there will be an increase in the need for archive banks like yours. Could a fundraiser for you help prepare for any possible demand increase?

匿名

I am not sure it is the right way: investments made with fundraised money will increase operating expenses too. Probably, beyond the value I can handle with pocket money. So I will have to run fundraising campaign every year, and depend on its results.

5 年前

Will a host website be able to see my IP address if I archive their page, or if I visit their archived page? In a previous answer, you said this is no longer true as of December 2019, but your answer was kind of ambiguous and I wanted to confirm.

匿名

No, there should be no requests to the original website from your IP, neither while making snapshot nor while viewing.

What was made in December 2019 is only replacing PhantomJS with full featured Chromium

5 年前

I noticed that some websites are cut off on the sides. /agRyL is an example of a webpage that does not show all the content due to the width of the capture not being wide enough. According to the "Top Ten Most Common Screen Resolutions", research says that for 2020, 1920×1080 is the most common. When your tech stack is ready, could you, sometime in the future, consider increasing the default width of your captures?

匿名

1920px width would make them unreadable on mobiles and low-dpi laptops

I don't know if this is happening on your end, but I noticed that some websites are automatically translated. What are your rules regarding which ones are translated and into what language?

匿名

There is absolutely no translation here.

Some websites (especially Facebook) love to auto-translate to an unexpected language, so the archiver has to fight with it by clicking on “see original“ button.

Google’s UI sometimes is in unexpected language too. I suspect that a neighbor datacenter IP might be used by people from Ukraine and Turkmenistan as VPN exit, so Google’s AI categorizes the archive as someone from there. No idea how to fight that.

What is the width of the snapshot page? Would you possibly increase the width in the future if you find that it is needed?

匿名

1024px for most websites, there are few exception which use wider screen

5 年前

There are some sites that allow accesses only from certain countries. (especially Japan) Do you have any plan to support these websites to be archived?

匿名

There are list of sites which need a proxy in a certain country.

If some site is missing, just let me know

5 年前

I see that several similar questions have been asked in the past, but I'm not sure about the current status of this issue: Is there a way to archive tumblr pages that are hidden behind a "This Tumblr may contain sensitive media ; Go to my dashboard" screen? They can only be displayed when you are logged in, as an infinitely scrolling panel on the dashboard. Trying to archive it "traditionally" simply archives the Log In page.

匿名

I do not even know how to see them :)

They are visible only as a narrow frame, about 1/6 of window width, so just entering username/password is not enough, the content has to be recovered from that frame.

5 年前

Is there anyway we can donate our residential IP address to your project?

匿名

What would be very useful is a residential IP address in mainland China.

I cannot open many .gov.cn websites, even from Alibaba Cloud

5 年前

As you are aware, some sites do not load if they are visited from a European IP address due to the site not complying with GDPR. I found a US border news site that needs to be loaded from another region. /TWnDg How do you normally handle these edge cases? Do you have to hand-code a list of overrides?

匿名

There is multi-exit VPN which does use USA IPs to access such newspapers. The bug here is: although the exit IP is in the USA, it is Netherlans in MaxMind GeoIP database :(

5 年前

The unfolding of quora answers is not working again since 2020-9-16 (example: 9vnYb, 52nJS)

匿名

fixed

Correct me if I'm wrong, but I once read somewhere that the limit for the number of archives a site can have is 1000. Is this true?

匿名

It is probable the limit of search results. There are numbers like 1000, 10000, …

5 年前

Hi, Thanks again for your amazing service! I noticed that an increasing amount of news are communicated via data dashboards. For example the various COVID-19 dashboards. It seems that archiving these is difficult as the dashboard visualization seems to have either a lazy load feature or some DRM complexities. Could you look at /ohXL0 ? This is a wild-fire dashboard for the United States and the archive shows the dashboard but its blank.

匿名

Fixed

5 年前

Will you offer a paid service? I want to pay you to scrape/archive my bookmarks.

匿名

No. You need something like Evernote for that.

5 年前

Is there a way to save something that is visible only to me (like a Facebook post in a private group)?

匿名

I think it is possible to add this feature to the browser extension.

5 年前

Your Facebook account is banned again...

匿名

Yes

5 年前

Why the long answers on Quora now do not unfold themselves (example: LGn9p)? Few days ago it still works (example: 828E2). Some the archives of the Japanese Quora has had the same problem for a few months already, that the first few long answers won't unfold (including but not limited to: KABrn, LVsqV .NVRQb, Q26Mu).

匿名

Quora has changed design a little bit. Should be fixed.

Regional versions are my bug, the archiver clicks on a button with “continue reading“ text, which is localized in regional versions. I will fix today.

5 年前

If I mailed you a bunch of hard drives and donated to cover your time, could I get a backup of your entire archive?

匿名

No. Both archive mirrors are not local to me and there are COVID travel restrictions.

5 年前

Why are product pages of Newegg being redirected to shopping cart? Example - archive is/JaQ5W How a product page would normally look like - archive is/UKQx6 Is the redirect caused by some kind of bug and can it be fixed?

匿名

Fixed (there was a bug: the click on [x] to close the modal popup was performed twice)

5 年前

How has the COVID-19 Pandemic affected the popularity of your service? Have you noticed an increase in sites archived or retrieved?

匿名

I spotted two projects which use archive to track COVID press coverage: https://ncovmemory.github.io/ (early days in China) and https://www.covid19-archive.com/ (woldwide news).

As for the numbers: we deployed a new system in December 2019, which is based on Chromium instead of old PhantomJS. It improved the quality of snapshots, but degraded the performance. So we have to limit the rates of archival and retrieval, and it impacted the stats more than COVID.

5 年前

I tried to archive the following page, but the subscribe popup still appeared, making the article darkend out. Can this be fixed? mississippitoday org-201-03-17-death-in-meridian-a-mystery-three-years-later

匿名

yes, fixed

5 年前

Jesus Christ I just checked the GitHub page (via a Reddit link) on this issue, and they freaking paid your friend! What the hell?! Opera is run by the Chinese Communist Party, but that's fine with you, whereas Brave is run by a bunch of libertarians and they're evil? Holy shit. Look at the last post on this page, is he lying? (replace DOT with .) githubDOTcom/brave/brave-browser/issues/10219

匿名

They did not paid many other Chinese, Russian, Indonesian, … and still have (probably the only) cryptocurrency with racial segregation.

The point of Brave userbase is also interesting: as it appeared after the block, their drive-by download program is popular among toxic websites, so the Brave block reduced popularity of the archive in those communities, which is sort of a positive move too.

So a browser that allows its users to retain all the privacy they desire... that's your version of a "scam"? Whereas a browser that openly spies on its users for a massive megacorporation (Chrome) is *not* a scam. Right. Talk about screwy priorities. If I don't want to see any ads on Brave, I don't have to. And I know they aren't spying on me. But because they pissed you off, I have to use a browser with spyware to use your site. Brilliant. Just brilliant. Is Google paying you? Is China? Damn.

匿名

They both do not provide enough privacy. Proof? When Facebook bans an account, it is not possible to use the same browser (whether it is Brave or Chrome, even in “incognito mode” and new IP address) to register new accounts for many days. Browsers leak enough information for Facebook to track you.

The problem with Brave was racial rhetoric they use to steal money: some races can receive their cryprocurrency while some other are not eligible.

How do NEW archives of twitter pages & tweets still show the real "GoodTwitter" layout? I thought the plugin stopped working and the GoodTwitter2 userscript isn't as close to the original "GoodTwitter" layout as the archives are (for example: the tweet overlaying the profile page instead of just a white background). Please, the new web 3.0 design of Twitter makes it so much harder to use.

匿名

Setting UserAgent to GoogleBot does the trick for most of the Twitter pages.

I imagine you get some disapproval of what you do and your archive. I would like to give you an example of something you could reference just in case you need to counter their criticism or censure. /hLMoL is an archive of a subreddit called "anime_titties". This isn't porn but is world news. There is no porn at this URL. Censorship by word list, would exclude this news discussion and community.

匿名

There is no keyword-based censorship

5 年前

Hi, I have noticed that an increasingly amount of websites with interstitials will not load the page until the box is clicked. I can imagine this is a game of wack-a-mole and a huge headache for your team. An example is /am6I7 . Could you take a peak at this site's implementation of lazy loading and see if solving this one is worth your time? I'm worried their method or used library might be used by other sites.

匿名

Fixed.

Yes, there is a big database similar to adblockers’ which require maintenance as websites got changed

5 年前

Hi, there is a cookies opt-in popup overlay on the site sfchronicle that hides the content underneath. Could you remove overlay for this website please?

匿名

Fixed

5 年前

Can you do something about yandex cache pages leading to 404? Example: DpSGL

匿名

They could be open only from the same IP.

If you send a link to yandex cache to somebody, they will get 404 too
:(

UPD: I rearchived it at https://archive.vn/J8tx9 Archiving Yandex Cache can to be solved, by simulating full user interaction with Yandex: entering the URL into the search form and then doing 2 clicks. I’ll try to implement it in few days

5 年前

hey youve lost a lot of users over your petty actions

匿名

What makes you think that fewer users is something bad (when there is no goal to pump the share price) ?

It would allow to cut expenses and to provide captcha-less access to everyone.

did you block the Dissenter browser?

匿名

No, Dissenter is very cool, it took the good parts from Brave removing all cryptoscam. But should be a way to detect Dissenter browser not as Brave, there is already a ticket for that https://github.com/gab-ai-inc/defiant-browser/issues/43

Please provide all the details about how Brave allegedly scammed your friend, because it doesn't make sense. They are about as far as being a domain registrar as is possible. If they did, or someone at Brave scammed your friend, please let us know all about it so we can get him made whole.

匿名

https://i.imgur.com/aJfPgX0.png

Aryanization as it is - stealing about $1500 (voluntary donations of website users) explaining this with discrediting on a national basis

UPDATE:

Why are you checking for "supported browser"? You have a simple html form. I'm using Brave browser on mobile which is chromium based, but the "unsupported browser" error shows and I can't get to the form. Seems very unnecessary, just render the page anyways.

匿名

Using other browsers prevents people from getting scammed by Brave.

Any details on this "nationalistic rhetoric"? According to an official post from June, the block was put in place because the company "isolated a high number of fraudulent referrers in specific countries"--namely, the five countries listed in your previous post. I'm not saying Brave is being an honest, upstanding company here--for example, it has failed to add this list of countries to the Terms of Service, over a month after the original post--but that doesn't sound very "nationalistic" to me.

匿名

Isn’t there much difference from “blacks are criminals“ in how particular cases extrapolated to color of skin or even color of passport? Especially when it comes to stealing from them and that motivates to describe the discriminated group as broad as possible.

Please, at least put a note on the unsupported page why Brave is unsupported again, I thought this was resolved

匿名

No, it hardly will be resolved.

it seems that Brave is a scam project by their nature (no wonder looking at their cryptocurrency affiliation). After I managed to transfer the domains to account of my friend, they blocked his account and stole all the tokens using nationalist rhetoric as a cover: they said that they do not pay to Russia, China, Vietnam, Indonesia and Ukraine (interesting, it wasn’t a problem before my domains was transferred there. so I feel guilty for destroying my friend’s business).

Blocking a minor browser who blocks half of the world *for profit* seems an adequate counter-sanction. I encourage webmasters (especially from those countries) to block Brave as well to stop spreading that scam.

I couldn't find it in the FAQs, but I'm curious: what's the relationship (if any) between archive-dot-is and archive-dot-org? (not that there has to be :3 ) Thanks!

匿名

There is no relationship

5 年前

For weeks now Discord is again not displaying previews for archive links. Is it a problem on your side or did they do something?

匿名

I will check, Discord Bot was whitelisted few months ago.

5 年前

what happened to the bookmarklets is is just replaced by the extension now?

匿名

Bookmarklet still works. There were few issues which makes the bookmaklet inferior to extensions so I stopped promoting it:

1. People do not understand where is “bookmark bar” and even what is it. The bar is not visible by default in modern browsers.

2. Firefox has blacklist of websites where all the bookmarklets do not work. The list includes “twitter.com” among others, to the bookmarklet did not allow to save tweets if you are using Firefox.

3. Since recently (somewhere between Chromium 80 and 85), `document.URL` on Wayback Machine pages returns url of the original page, having “http://web.archive.org/web/YYYYMMDDhhmmss/” prefix stripped. This breaks bookmarklet too.

5 年前

Do you know why the archive button disappeared from the chrome web store?

匿名

No, I do not.

Those buttons are made by other people, not by me, so it would be better to find …an archived copy of the page from chrome webstore with the contact information of the authors and ask them.

5 年前

Hello. I am new to this website. Does this website act like the WayBack machine where pages are automatically saved by the website for users to see? Or does this website need a person to on purposely copy and paste a url into the archive to save its contents?

匿名

It needs a person to on purposely copy and paste a url into the archive to save its contents.

At the time Archive.Today was created, The Wayback Machine was not able to save pages on demand, while increasing share of dynamic and realtime content in the Internet (so to say, the transition from “writing“ to “speech“) was destroying the very idea of Hypertext (when every page could link to another and every reader will find there the same content) and it was frustrating. So, our idea was not to crawl and preserve the entire Internet, but merely to freeze the pages before linking to them. And this implies the presence of the person.

Hi. I'm trying to use ArchiveIs in an Alfred workflow. It submits webpages via the archive now python library. The problem is that during testing, I'm getting a lot of 503 from the server. Is there a rate limit? Should I identify as a specific user-agent? What am I missing?

匿名

Yes, it is likely rate limiting showing a page with captcha

5 年前

Hi, I am not familiar with programming, I read question 75363302879 (does-archive-is-have-api) but I don't really understand it. I want to ask if this idea I had is feasible: I want to write a program that saves bookmarks, and when adding a url, it will automatically run each url through archiveis as well. Is this allowed, do you limit use of your service? Or do I need to "self-host" whatever technologies that archiveis uses. Thanks.

匿名

For self-host try https://github.com/pirate/ArchiveBox or https://github.com/webrecorder

whats the domain name? the name everyone calls it is archive. is, when i visit archive. is the logo says archive. today and when i click that it takes me to archive. vn. whats going on?

匿名

It is intentional.

No single domain is reliable and I have no means to enforce control on each domain.

* archive.today - threatened with confiscation http://blog.archive.today/post/116913927371/the-domain-registrar-gransy-s-r-o-aka, also a troll attack caused service interruption https://blog.archive.today/post/138982909006/domain-problems-again
* archive.is - threatened with confiscation https://twitter.com/archiveis/status/1081276424781287427, asked not to use “archive.IS” for branding (that’s why you see “archive.TODAY” in the top-left corner; although many people remembered it as “archive.IS” and refer it so)
* archive.fo - threatened with confiscation https://twitter.com/archiveis/status/1188222460598116353
* archive.li - attacked by trolls impersonating police, caused few days service interruption https://twitter.com/archiveis/status/956025540028268547
* archive.ec - attacked by trolls causing service interruption and finally lost https://twitter.com/archiveis/status/1093608363647291393
* archive.vn - ok so far
* archive.ph - ok so far
* archive.md - ok so far
* a nice domain unrelated to archive - one day whois started showing someone’s else information and the registrar did not response, the domain was lost

Thank you for everything, as always! Just wondering if there's any chance of eventually bypassing whatever mechanism instagram implemented to disallow archiving? Hope you are well!

匿名

They do not disallow.

The problem is if many requests come from a single source IP address, Instagram redirects to login page prompting to log in (and then limit access rate per-account instead of per-IP).

The archiver just retries using another IP. Usually it helps, but apparently it does not have enough different IPs to cope with the spikes when a bundle of Instagram pages are submitted.

5 年前

Hello, on some websites there are cookie opt-in pop-up windows, which hide the content underneath. Can I skip this pop-up to archive the website?Example: the websites of jimdofree or jimdo (links cannot be entered here) regards Daniel

匿名

Fixed

5 年前

How did you change back to the old Twitter layout? I'd thought they disabled it at the start of June, so I was pleasantly surprised to see my archives from earlier today show up with Twitter's old interface.

匿名

They show old interface to Googlebot, so a fake User-Agent does the trick

tor v2 hidden services will be depreciated in a year or two. are you planning on upgrading to a v3 hidden service, and if so, when? thank you for your service :)

匿名

It works already at

archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion

I tried to donation from Japan more than 8 times with various settings and methods, but all attempts rejected.

匿名

Could you tell, which do work and which don’t?

Yen, old design:

https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=23TJEESEC5C8N&source=url

Yen, new design:

https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=WXWWS48TB6HRN&source=url

Dollar:

https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=RSCFSJ2SAZJL8&source=url

Euro:

https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=XTNDVVFY5FC4W&source=url

Facebook pages aren't archiving properly. I used to be able to archive and it would bypass the login. Now when I archive pages I either get the public page or a 'Page Not Found' which usually indicates not being logged in

匿名

It requires many new Facebook accounts.

They are not free (at least phone numbers are in the costs).

That makes bypassing Facebook login a premium feature someone has to sponsor (I wouldn’t just because I do not need the feature).

There is an option to report archives for "Government Criticism." Please elaborate on exactly what this means.

匿名

The whole list is a copy-paste from another website (I forgot which one; probably GitHub), no item has implied meaning.

5 年前

Hi, is it possible to archive a facebook video from a link?

匿名

No, videos are not archived.

Try something likr youtube-dl (despite the name it supports almost all video websites)

5 年前

For the last two days, the archiving of images in tweets with the "This media may contain sensitive material. Learn more" label no longer works. Now, only the tweet text is archived, rather than the images as well.

匿名

Examples?

Do you archive the SHA-hash of the site's certificate? Sometimes the actual signature of the soucepage might be of interest.

匿名

No.

But some certificate info are archived (issuer, validity times, … more here https://chromedevtools.github.io/devtools-protocol/tot/Network/#type-SecurityDetails)

Is there a place where you list all the mirrors? If not, do you mind listing them?

匿名

Here https://en.wikipedia.org/wiki/Archive.today

5 年前

Can I donate to you with BAT?

匿名

Technically - yes.

I have transferred the domains to an account of a friend who has verified Uphold account, but we have not received BATs yet (there is 1 month hold).

Compared to LiberaPay and PayPal, it is still untested channel.

UPDATE:

Brave has blocked that friend’s account, so please do not send any BAT. It looks like Brave is a scam.

The "download zip" button has been giving a "Not found" error for quite some time.

匿名

Yes, it is broken since December 2019.
Since then the archiver works differently and although that improves
quality of the pages, the internal format (how pages are stored) got
far from good old html+image files and that requires additional coding to produce .zip files on demand. I hope to fix that in few weeks

You know how when you archive a Google cache page it shows the "Saved From" & "Original" links, and allows you to search for the archive with the original link? Well archiving from Bing and Yandex cache shows the saved from & original links, but doesn't allow you to search by the original link, only the "Saved From" cache url. Can you fix this please?

匿名

Could you profide specific example?

5 年前

Why is everyone so hostile and angry in their questions? Was it always like this?

gfair

I think it is ok. The style of bug reports in open-source world is very similar.

5 年前

Why the hell should I use you or donate if I have to go through dozens of captchas for having used TOR? Are you spying assed Google or Apple or NSA?

匿名

You do not have to use. The less people use the site, the faster it works. The less are my expenses. So you could donate by not using.

As for Tor: archivecaslytosk.onion is catchaless, the captcha is there only when vanilla websites accessed via Tor exits (which are apparently in many blacklists including one of recaptcha)

How many does it cost to host this site per day?

匿名

Under $100

Hello, Do you have a status page? Sometimes I have to wait between 20-35mins for an archive to complete and I wanted to check if it was just me or if you were doing maintenance? Thank you for all that you do and keep fighting the good fight. I will keep donating!

gfair

It was at http://status.archive.is but it seems broken now, so it requires another status page which will show the status of status page.

As for 20min: it could happen if the archived page did not pass some quality checks, for example if there is a captcha or error page or redirect to login instead of the content. In this case, the archiver retries using another browser and IP. 10 times. At most it is about 20-25 minutes till success or give up

What happened to your liberapay donation account? I noticed that you are now linking to a paypal donation page. Would you prefer we switch to that instead?

gfair

Liberapay link are on each snapshot page. Direct PayPal in only on the main page.

It is just an experiment (A/B testing if you wish). People asked to have an easier way to donate, without registering Liberapay account and commitment to recurrent donation.

What happened with your twitter logo? How could someone copyright claim your logo? This world is going insane

gfair

Yes, it is very easy to remove anyone’s image from Twitter just by sending a bogus copyright complain. And difficult to restore (there is a restoration procedure called “DMCA counter-notification“, but Twitter ignores those notifications. Although they report on their corporate disclosure page that satisfied 100% of them)

I find it ironical to have such a logo which highlight the ephemerality of Internet content and importance of having archived copies

5 年前

Archive, I don't train google's AI for just to read an article. I'm on a paid only vpn, not even tor. Can you please adjust the reCaptcha aggressiveness?

匿名

Why should a free service provide free support for 3rd party paid services?

Ask them to provide you IPs which are not in recaptcha blacklist or do not pay them.

Would you consider dropping google's recaptcha for hcaptcha instead. HCaptcha does not sell personal data and collects only minimal data. Performs as good or better. Includes solutions for visually impaired and users with other accessibility challenges. The solution works in regions in which Google is blocked. They offer better support. You don't spend 15 minutes solving captchas because you are poor and using an old browser on old hardware. Please look it over. Thank you!

匿名

Actually, I am having troubles solving hCaptcha challenges :)

A captcha-less wall will be implemented soon

I from the region which block archive today, and my proxy/VPN provider use the only DNS upstream is cloudflare-dns which cannot query correct IP, still hard to access this website. Any idea?

匿名

The Cloudflare DNS issue is unlikely to be solved ever. It gets only worse with time: instead of implementing ECS Client Subnet, they tried to “fix“ it by proxying requests related to my domains to other free DNS services. Those are much smaller than Cloudflare so some or them blocked excessive requests coming from Cloudflare. Now if you send requests to 1.1.1.1, it is re-sent by them to another DNS service, which is likely won’t answer. So 1.1.1.1 responds to you with SERVFAIL or REFUSED with no request sent to me. This broke the features which were working only a week ago - IPv6 and email. So, the things here do not converge to a some stable state, they only decay.

As for region blocks: what region you are in?

AFAIK, even Australia, China and Russia have lifted the blocks.

What is left?

Why does archiving individual instagram posts work but not the main instagram pages?

匿名

instagram often redirects to the login page. in this case the archiver retries. Sometimes it helps, but sometimes even 10 retries do not help. Then it gives up :(

Hello! I recently archived a few Facebook posts, written in Ukrainian, and noticed that text in the archives is auto-translated into English. Example 1: old archive, text in Ukrainian - fZXTu ; new archive, text in English (auto-translated) - mKTyM . Example 2: old archive, text in Ukrainian - TRDxJ ; new archive, text in English (auto-translated) - cJ4oA . Could this behavior (auto-translation) be disabled or bypassed, so non-English FB posts could be archived with original untranslated text?

匿名

Done.

I did not add all of the languages to new Facebook account’s language settings suspecting it might be one of the reason they blocked new accounts so quickly: they might think that one who does not need translations from 50+ languages is definitively a non-human.

Why the fake Cloudflare verification? Cloudflare uses hCaptcha instead of Recaptcha and I think hCaptcha pays for you to do captchas (some AI thing). Plus the verification page isn't mobile friendly

匿名

That’s legacy. A temporary solution which left for too long. I have an idea how to do it without captchas at all

5 年前

Have the problems with Brave Browser been fixed? The Github issue has been closed.

匿名

I hope so.

Doesn’t it work in Brave?

Firstly, thanks for answering! "Maybe to ask Facebook login/password from everyone who is trying to archive a page from Facebook?" -- hopefully, not. I don't have a FB account and if this will be implemented, I would stop using ArchiveIs for a FB archivation (sadly). Why ArchiveIs using FB accounts at all? I can visit a public FB page using a link and browse its content just fine without an account (as I usually do). And Wayback Machine (web archive org) can archive FB pages without an account.

匿名

Many pages are required to log in. And log in is required to see comments.

5 年前

Hello! Recently I have a problem with archiving Facebook pages. Instead of the page content the archive contains only "Your account has been disabled" message. Few archive vn examples: XAMnc vHSFJ . Could you fix it? Thanks.

匿名

Facebook accounts do not live long. They disable accounts at random and ask to send them “government id” to unblock.

It looks like viewing particular (adult, politics, …) pages triggers Facebook’s interest in true identity of an user.

Any ideas how to deal with that?

Maybe to ask Facebook login/password from everyone who is trying to archive a page from Facebook?

5 年前

Sometimes, comments on Github issues get marked as off-topic and aren't visible unless one is logged in and clicks on the comment area. Could fetching of Github issues be authenticated, similarly to how facebook pages appear to archived under a logged-in account?

匿名

Can you give an example of such page (here or by email)?

6 年前

Why are you not loading in Brave or Chrome? Only in Internet Explorer?

匿名

It should work in Brave and Chrome.

Like, while I understand there is an issue, I had to do some active digging to determine exactly why I was being redirected. It would be helpful, at the least, to provide more than a tangential explanation. I doubt I am the only one that has no idea what the heck you are talking about when you say "I am not able to confirm my domains in the Brave control panel", and quite frankly, I don't think I or anyone else should need to research the problem to get some transparency.

匿名

The problem is Brave makes people think that BAT is a legit way of making donations to Archive.Today (see earlier questions here).

It is not. All those “tokens” go to limbo.

What I want is to opt-out of Brave program (”do not show ads on my websites and do not allow people to make donations in BAT“) and they do have the webmasters control panel where it supposes to be possible to set up. But it is broken and Brave support does not answer, for 2 months already.

So I see no other way to prevent people from being scammed than to block Brave.

May I ask why do you log users' ip address?

匿名

The most practical use is to tune captcha (to find blocks of IPs with many bots). I have to do all the routine usually delegated to Cloudflare or Fastly.

So when will you be done throwing your baby tantrum?

匿名

Just after Bill Gates who redirects them to https://www.linkedin.com/error_pages/unsupported-browser.html

Are you going to remove the redirect code that anonymously and non-consensually forces Brave users to the page of a bug you reported?

匿名

I am not able to confirm my domains in the Brave control panel for 2 months already, so there is no other way left to prevent Brave from putting ads to the websites than to hide it from Brave users completely prompting the users to use less scamy browsers.

When someone archived a page, did the person remain anonymous? In other words was the person's ip address logged when they archive a page?

匿名

Yes, IP address is logged

is index still corrupted? I cannot find my archived pages...

匿名

It should work now.

Could you send your queries to webmaster@archive.today, and I will check.

6 年前

I'd love to send you BAT - consider registering your sites to receive BAT donations from Brave users.

匿名

Please do not send BAT.

The domains are in a weird state of transition between two accounts for more than a month, and Brave support does not respond.

https://i.imgur.com/cuEmrIf.png

I couldn’t find some archived webpages. Were they deleted?

匿名

No, just the index got broken. I’m repairing it. It will work in 2-3 hours.

Can you post stats? Such as "Web Pages Archived in the Past Hours/days" and/or "kb archived in the past 24 hrs" or other. It would help people understand where their donations go and why it's important to donate.

匿名

There is RSS feed at http://archive.today/rss with recently archived pages.

I’m not sure it’s a good idea to make reports out of this, because

1. There are tons of NSFW pages submitted to the archive. This would make the report page NSFW too.

2. There are some spam pages (landings full of ads submitted by bots) which won’t stay long, so people would see how some archived pages are disappearing.

The donations ($300/mo, stats are at https://liberapay.com/archiveis/) go to cover 1/7 of the expenses: server colocation in 2 countries, about $1000/mo each + about $100/mo for dozen of cheap cloud instances around the world to form a pool of public IP addresses (for multi-exit VPN, etc)

I notice when I use one of your archive links in a post on my Minds channel Minds mangles the preview so that the original article headline gets replace with "Attention Required!" Not sure if this is something you can address by whitelisting or not.

匿名

Fixed

6 年前

What scraper or headless browser are you using? it works so well.

匿名

Before 2019 - PhantomJS, after - ordinary (not headless) Chromium/80 with few small patches.

6 年前

The internet archive is now editorializing archived pages related to "misinformation", in other worlds information control. Will you commit to neutrality and leaving pages as is?

匿名

I leave as it is because it would require a lot of work to separate “misinformation” and most of the content will be in grey areas of artwork (is any text mentioned Harry Potter misinformation?), mythology, advertising, investment advice, weather forecast, etc.

Everything you see in the Internet requires a critical attitude.

6 年前

it is difficult to donate via Paypal need more ways to donate

匿名

For example?

What if i will use archived page from here in court as proof But my defendant will ask you to delete archived page or switch off the site Then will you delete archived page or switch off the thr site or what actions to be done ? And how long this site can live ?

匿名

I am not sure it could be used in court simply because it is possible to craft a page for archive that differs from what others see.

I archive a lot of high risk political material. I use a special add-on for my browser that allows me to export my url history and such. It is also configured restrict certain functions to reduce the risk of tracking. Now that you have placed google's recaptcha on every single page the site is no longer usable for me without compromising my privacy in a substantial way. I know bots are a big issue, but PLEASE find a more intelligent solution without exposing us to google's surveillance.

匿名

Captcha is shown only to hosting IPs (such as Amazon, Linode, OVH, …).

I see that many VPN exits have those IPs too and they are difficult to separate from servers.

Probably the solution here is to drop me a email like “I am using VPN, my IPs are usually within range 1.2.3.4-2.3.4.5, please whitelist“

Hi! :) Since you recently added a captcha to avoid bots, I would like to suggest you to use hCaptcha (instead of reCAPTCHA), since it's much more human friendly and less annoying than reCAPTCHA (which usually constantly fails, even after correctly solving the captcha). I'm not affiliated with hCaptcha (I'm just a simple user from Argentina), and I would like to note that hCaptcha is a trusted captcha service which is currently used CloudFlare. Would you take this suggestion in consideration?...

匿名

I hope it is not for long time

6 年前

Discord doesn't load previews of archive links anymore. is that because of the newly introduced captcha system on your part?

匿名

Yes, I will whitelist Discord in few minutes.

Sorry for captcha, the number of visits is so high so I had to limit it somehow until next hardware upgrade.

6 年前

I make a political podcast and have 30-50 links of my sources once in a week. Unfortunately, Tweets and articles may get deleted over time. Is there any way to automate archiving those links? Or at least the Tweets only, so I can prove that someone posted something?

匿名

There is no “official API“, but there are number of 3rd party libraries on GitHub and language-specific repositories (such as NPM), try to search for “archive.is“ or “archive.today“ there to find it for your favorite language.

6 年前

hi, i'm trying to use archivenow on github to help with misc archiving (news stories, etc) but your service for certain urls doesn't return a refresh header so archiving fails. archiving pages manually fails too also with no refresh header.

匿名

For bug reports, please, provide more details (which sites, when, …). It works for me and I see no failures in the logs, so what can I do ?

6 年前

Could you post an up-to-date list of the IP addresses that are used by your archiving system?

匿名

No, the dynamism of the IP list is sort of a secret advantage which allows to bypass many anti-bot protections.

If I publish the list, some websites will block all the IPs or provide tailored content.

Hi, I want to make sure you know all the archive mirrors have an issue being accessed from Firefox with adblock enabled and cookies disabled. It gives a cloudflare error message saying the site archive ph can't be found. I tried it and it works in other browsers. It used to work before with my same settings, so this is a new error. It means my archiving extension doesn't work anymore. Could you please fix this? And thanks for everything Archive, I appreciate your service a lot!

匿名

https://www.google.com/search?q=firefox+how+to+disable+dns+over+http

6 年前

What timezone is archive timestamps for?

匿名

UTC

how do I make a snap shot with some delay so that some elements have time to load? Some corona site only have the number but not the map in the snapshot (because it takes some time to load), and the element of requesting email for newsletter also gets in the way.

匿名

Report it as a bug and I will fix it (either be adding a delay for the website or by special handling some class of map sites)

Over the years i've noticed a huge increase in the numbers of queue'ed pages waiting to be archived. Is this normal or is the site under attack.

匿名

I’d say it is normal for the current number of servers and number of submissions.

The solution might be somewhere in adding more servers, which means introducition some sort of monetization: premium accounts or aggressive asking for donations

Don't let that POS Michael Bloomberg get away with this again. He's blocking you because he doesn't want people archiving all his investigative journalists during this market collapse. He removed all of Mark Pittmans articles during the 2008 financial collapse...He must be stopped! You are our only hope!

匿名

The problem with bloomberg.com is not blocking, it is often shows a captcha so the archiver has to retry using different exit IP addresses and then it gives up after 8-10 failed retries. Most of pages are saved well, but there are many failures too because number of retries is limited.

Will you fix the resolving of your domain on Cloudflare DSN? community[.]cloudflare[.]com/t/archive-is-error-1001/18227

匿名

There are so many “if (cloudflare) {” on my side and “if (archiveis) {” on their, left from the attempts of fixing, so the convergence is hardly possible.

Some of their nodes send requests to me, some proxy the requests to Symantec DNS and it works sometimes, some (Hong Kong, …) always answer with SERVFAIL (probably they used to send to a proxy which went down since then)…

6 年前

Do you have a sense for the country breakdown of your users? Are Europeans more frequently archiving pages than Americans, for instance?

匿名

There are too many Tor and VPN users (with IP of DigitalOcean, for example) that it would be difficult to make an accurate report.

Japan and Korea are very active. Perhaps they are claiming first and second places, rather than the US and EU.

6 年前

I would like to make a charitable donation to support internet archiving, like what you do. Any suggestion? I kinda don't want to donate to Internet Archive, because they remove content.

匿名

https://liberapay.com/archiveis/

6 年前

Nobody fucking gets their TLS cert revoked over some trolling or bad content. Lets Encrypt literally refuses to play content cop as a CA. it's core to their premise as an organization. Look up their blog entry "The CA's Role in Fighting Phishing and Malware" (spoiler: it's no role at all)

匿名

I fail to see how blog posts (which itself is a perfect example of the content to be silently altered or wiped) get the performative power which one could rely on

can you expand hidden github comments. it says '84 hidden items/Load more...' at e.g. /7cxnj

匿名

Yes.

There used to be expanded, but something went wrong. Fixed now

6 年前

Can I make tax deductible donation to support archive is?

匿名

No

I have been told that “Higbee and Associates” copyright trolls [1][2] (and probably their clones) have been used Archive.Today’s snapshots as “evidences” of “crimes” of their victims.

We are not associated with those guys and never heard about them before. Archive’s snapshots are not notarized nor use strong anti-forging technologies, so they cannot serve as legal evidences. Shortly, if you received a copyright claim with Archive’s snapshots as a proof - it is a scam.

There is the second floor: other guys (for example [3]) try to extort more money from the victims of aforementioned scammers for archive snapshots removal in order to protect them from further attacks.

It is a scam too, do not pay them.

1. http://archive.today/2020.02.17-184546/https://pubcit.typepad.com/clpblog/2019/02/consumer-warning-copyright-trolling-by-higbee-and-associates.html

2. http://archive.today/2020.02.17-184543/https://www.techdirt.com/articles/20190220/13283641640/investigating-higbee-associates-copyright-trolling-operation.shtml

3. http://archive.today/2020.02.17-183946/https://sumbit.nl/prijs.html

Why can't we archive URLs on Plurk? Did they implement some methods to prevent archiving?

匿名

plurk.com? It works for me. Which page do you have problem with?

6 年前

What about the CA "Let's Encrypt"? They seem good. Nonprofit. You still support HTTPS connections, just only when explicitly instructed or you have HTTPS Everywhere installed. HTTPS sites get better SEO as well. I fail to see how this site is any more controversial than similar platforms like Wayback Machine or Megalodon.

匿名

The Archive’s ability to preserve short-living content of social media turned it to a lovely instrument of troll wars (Alt-Right vs. SJW, Ukraine vs. Russia, …)
and although the Archive tries to be neutral to those battles, it was often under the fire of technical and social attackers.
The pattern of attacks resulted in our infrastructure became similar to those of Wikileaks, SciHub, 8ch or DailyStormer - many mirror domains, fast-flux IPs for ingress and egress, etc.
If there are attacks which have already been made against one of the websites in this karass, the rest have to be prepared.
Revocation of SSL certificate as the result of some social attack is very likely, so I would even argue for using plain http in links to the Archive.

6 年前

why no longer archive 'good' twitter? recently archive is now new style which is very bad

匿名

This https://www.reddit.com/r/Twitter/comments/ce1bea/reverting_back_to_the_old_twitter_interface_for/ ?

Just enabled, let’s see.

do you store logs? if so, what do they contain and how long do you keep them?

匿名

Yes, approximately 3-6 months. Useful for debugging and to track spammers.

The logs are not archived to the storage, as they fill the webserver’s disk space they are deleted

6 年前

Can you get the pdf's to archive again? Before you used to have to automatically archive pdf's, which was extremely useful because you could pull links that would take you to direct line items buried deep within the document. Thanks

匿名

It never worked with PDFs actually.

It used to prefix links to PDFs with `http://webcache.googleusercontent.com/search?q=cache:` so a poor google cache’s PDF-to-HTML converted did the job.

But that approach had obvious drawbacks:

1. low rendering quality

2. many PDFs are not in google cache, and this hack does not for them

Examples can be seen here here: archive.today/http://webcache.googleusercontent.com/search?q=cache:*

If it is what you want, you can always prefix links to PDFs with that magic string before submitting to the archive

Do you plan on setting up HTTPS fully (i.e. forcing HTTPS even when requesting classic HTTP like most websites do nowadays). Good job on this project th

匿名

No.

I see the only reason to do it - to improve performance by forcing http2. But in case of archive, the performance bottleneck is not the network, but the speed of spindle disks.

On the other hand, there are two drawbacks of forcing https:

1. for the bots it is harder to support SSL (for example Perl does not
include SSL libraries by default).

2. certificate authority is an additional point of failure which
could go mad: there were cases when SSL-certificates of controversial
websites have been revoked.

6 年前

In FAQ I read "But take in mind that when you archive a page, your IP is being sent to the the website you archive as though you are using a proxy". So if I archive a page, will the website know that a certain IP (mine) visited them through archiveis? Or in other words, will the website owner know that their website has been archived through archiveis by my IP?

匿名

Yes, but it obsolete, it is not so since December 2019′s big update.

The idea of passing client’s IP in X-Forwarded-For was to let the server provide to the archive the same localized version as the client has seen, It worked in 2012, but not in 2020.

6 年前

why are you imitating cloudflare's captcha page? funny joke?

匿名

It is well recognizable as an interstitial page, caused by too many requests. Explaining this message would require too many words which no one would read. An orange page with captcha on the left does it instantly, as an hieroglyph of the universal Internet language.

Is Archive Today down? When I try to visit on Chrome I get a message which reads "This site can’t be reached". I've also tried visiting individual mirrors like VN, PH, IS, etc. and the website just keeps loading endlessly, but never actually completes. The problem started yesterday morning and since then, I haven't been able to visit the website or any archived page.

匿名

No, it should work. There were no outages in the last days.

6 年前

The Twitter profile page and replies full page url version capture no longer works, only individual Tweet; is this deliberate by the ArchiveIS' service or did Twitter modify the way their page loads to disable?

匿名

api.twitter.com responses with “429 Too Many Requests“. It seems I need more twitter accounts

How come the PDF's won't archive anymore? They used to archive, but now you just get this black page. It used to work though.

匿名

They never worked.

PDF support is in my TODO list, but it is not implemented yet.

So far you can use documentcloud.org or archive.org to store PDF

Do you have an API that I could license from you for use in other projects?

匿名

No

Why archiving is so slow?

Webpages appear instantly in browsers, so people wonder why archiving took dozens of seconds, sometimes 3-5 minutes.

There are many reasons:

1. The instantly loaded page might have nothing but “loading” spinner, so there are intentional delays.

2. Webpage might have pictures loaded lazily, only when then user scrolls page down. The archiver scrolls the page here and there to load those image, even if the page lacks those lazy elements: it just has no idea so it makes a pessimistic assumption.

3. Webpage might have have analytic scripts which invisibly work in the background. The page looks loaded if you look at the screen, but it is still loading if you look at networks events. It make difficult to detect the moment when the page loading is completed. Even more, there are pages which do not stop loading at all (news feeds, stock market charts, …)

4. Archiving process has more steps than just load a page. It is better to compare with loading a page and then send it to paper printer.

6 年前

Hi. When I get the same web page with the same URL after a certain period archived, would the last data be deleted and updated while I need to maintain both the past pages and today's instead?

匿名

No, both version will be in the archive and linked with <-prev next-> links

6 年前

I noticed with the new upgrade (which is nice for most of what I've seen!), the rewriting of links so that clicking on links in one captured webpage allowed you to visit another captured webpage (if it was captured) seems to be gone. Could it be possible to have it again, for browsability?

匿名

Yes, the update broke many things which have to be restored

6 年前

Is there a need for infinite captcha loop just to view archive on onion site? Also google captcha is terrible, i rarely manage to pass it first time no matter how much i squint my eyes. Is there plan to replace it with something else? Kissmanga for example has their own captcha similar to googles and it works fine.

匿名

Yes, I will replace it with something simpler to solve

6 年前

Archive is now demanding an I'm not a robot verification page every time I try to save a website, and each time it saves it either with a blank page (though screenshot still saves). Only media pages like those of news sites seem to save properly. Is this a new update or what? I don't really mind the I'm not a robot page but the sudden errors in saving certain pages (such as imgur or twitter) is rather sad since archive has been a great tool for me for several years.

匿名

Actually there should be less errors and blank pages since the last upgrade.

Please report bug for particular website or page

6 年前

I looooove your service but I’m wondering if you could remove the tabindex values for the form on the front page for those of us who want to press tab instead of clicking a mouse? Thank you!

匿名

But.. tabindex is exactly to simplify mouseless UX.

Initially the focus in on the first input field, a single tab moves it to the the second.

The buttons do not have to get focus because pressing Enter then the focus in on the text field does the same as pressing the button,

6 年前

archive·is and archive·today aren't working. I could access archive·md and the TOR service. Oddly enough blog·archive·today works. Are you guys being targeted by a deplatforming attempt? I wanted to DM you on twitter but couldn't because you don't follow me so I thought this channel would be the best to report the issues without bringing unwanted attention. Keep up the good work!

匿名

If you are in one of the coutries with state firewall (Russia, Australia, Iran, …) most likely the older domains (.today, .is, .li, .fo) are blocked there and the newer (.vn, .ph, .md) work. It takes 1-2 years for a domain to get into the blacklist on state firewall (a single page with political propaganda is enough) and it is almost not possible to get out.

The cause apparently is not an a troll attack, but the following sequence of events:
1. Whois of all .FO domains have recently been changed to gudrun@nic.fo, probably for some data protection compliance (my fault is I did not notice the change)
2. The robots of “crawling security companies”, which do crawl the Internet for movie and mp3 names started sending email reports to NIC.FO instead of me
3. As the archive has by far more content than the rest of .FO internet segment, the number of emails with “illegal reports” has overthrown their capacity
4. They came up with the optimal solution to delete the domain
5. PROFIT

I see the new .MD domain (archive md) and 9 months ago you said (archive is) would stop working but it's still going strong. Any backstory on the domains, which ones we can expect to keep going, other aliases that we don't know about, etc? Also I cannot type the domain name with a dot, your link checker says not to include links. Maybe that's a tumblr issue.

匿名

Based on the story I can only predict that there will be approximately one trouble with domains per year and each fifth trouble will result in domain loss.

The forecast is no one of the current domains (with the exception of .onion ones) will work in the next 20 years timeframe, but there will be other domains.

I see it as an imminent problem and can only accept that.

The domain system is managed by the people with the commercial mindset so they optimize they workflow either for more money or for spending less time for the fixed work. If one of the domains requires them to read many silly emails they are happy to delete the domain. There are many attackers who know and use it, for profit (with a strategy to take control over a deleted domain and sell it later as it happened with archive.ec) or just to deplatform a website which they do not like.

Another problem is the domains are used on state firewalls for geo-blocking, some of the domains are blocked in Russia, some other in Australia, etc, while the website is still accessible using other domains. So to say even the active domains are half-dead already.

Unfortunately, any of these two problems prevent implementing some nice features, such as embed codes.

Excuse me, your website seems to be having problems archiving pages on the Spacebattles forums. Every time I try to archive a page, I get a network error. Mind taking a look, please?

匿名

https://forums.spacebattles.com/ ?

I cannot open it, there is infinite loop of redirects

Hello. When archiving Twitter, if there is a sensitive image, the message "This media may contain sensitive material." will be displayed and the image will not be saved. I want to be able to save this image. Can you fix it? Thank you.

匿名

Could you provide an example?

7 年前

Please come back with the domain Archive. IS

匿名

.IS domain will likely stop working soon

How do I use the bookmarlet? I have no idea what "drag to toolbar" means. What toolbar? Where am I supposed to drag it? I'm using Microsoft Edge.

匿名

Like this http://archive.today/ZPzxt

I looked in the FAQ, didnt find an answer, so I'll ask here. Have you considered trying to connect your database with the wayback machine's database? So that when someone searches for a page, they are actually searching both archiving websites simultaneously.

匿名

There is http://timetravel.mementoweb.org/ for that

Is there any reason to delete products from Amazon? I have saved several products this week to see how the price changes and have disappeared. Why did this happen? I do not get it.

匿名

I have not deleted, it might be just difficult to find the saved pages

Why can't I see a complete listing of everything saved for twitter ThomasArzi

匿名

http://archive.is/https://twitter.com/ThomasArzi/* ?

Please accept cryptocurrency donations, e.g., BCH, ETH, XMR, ZEC, PIVX.

匿名

I hope it will be possible soon.

You may want to help implementing that here: https://github.com/liberapay/liberapay.com/issues/364

What happened to all of the archives of twitter com/ streaminarzi

匿名

this http://archive.is/https://twitter.com/StreaminArzi/* ?

Gransy/Regtons offer “whois proxy” which will list “yourdomain.com@fablovkawhoisprotection.com” in whois data instead of your actual email.
On “fablovkawhoisprotection.com” they use overstrict anti-spam filter which rejects emails sent from Gmail.
If someone send a message to “yourdomain.com@fablovkawhoisprotection.com” from Gmail, you do not receive it and the sender will get the error back:

No wonder such a unstable email service raises ICANN compliance reports about invalid email in whois.

No wonder that people unable to contact the domain owner via email have to fill the Whois Inaccuracy Complaint Form https://forms.icann.org/en/resources/compliance/complaints/whois/inaccuracy-form

So far so good: there is a bug, there is a report, there should be the fix.

But not in case of Gransy.
Referring to the letter from ICANN, they were trying to collect as much personal documents of domain owner as possible threatening to remove a domain (two documents were not enough, they wanted more, apparently to perform the identity theft) and completely deniyng the issue with whois proxy email.

The most technically incompetent registrar I ever seen. Zombies.

Dear archive project, I have been working on recreating the history of the small but very active indie gamedev community on 8 chan, called agdg. I noticed that there is a time between may and august of 2015 when no archives are available for the imageboard, outside single snapshots. I read somewhere that they were removed due to inappropriate content, but I decided to reach you in hopes that perhaps you maintain some archives from that time.

beelzebox

Yes, loli-related pages (like /hebe/) have been hidden.

As for /agdg/, there are really only a few pages have been archived.

Only http://archive.is/https://8ch.net/agdg/* http://archive.is/https://8ch.net/agdg/* http://archive.is/http://8chan.co/agdg/* https://archive.is/http://8chan.co/agdg/*

AFAIK, there were projects with the goal to archive whole 8chan, they may have more

Attack on .ch and .li domains

A nice story happened few days ago: Switchplus, the biggest registrar of .ch and .li domains have blocked the archive mirror domain “archive.li”.
The reason was “we have informed by the police that there is ‘illegal content’ hosting on the domain”.
They also treatened to delete the domain after 3 days of blocking.

After short interview[1] it was discovered that the “police report” has been sent not by the police but by a random person who simple wrote “detective sergeant” at the bottom of his email.
And what made the Switchplus executive believe that the email was really send by the police is that it was a “repetitive case”.
How nice.
When Switchplus receives few emails signed by Nigerian King, it would ensure them they are talking to real Nigerian King.
A rowhammer attack, huh.

I was under impression of talking to an inexperienced junior employee, but quick googling revealed that Wolfram Schmidt is the CEO of Switchplus, about 50 years old[2].
He manages assets of thousands people and feels right to sequestrate them based on fake email messages in his inbox.

If you - my reader - have a business competitor with a website on .ch or .li domain, you might easily destroy the business of the competitor by sending email message to Wolfram Schmidt telling that you are a Nigerian Detective and you found something illegal on the competitor’s website.
You do not even have to point what exactly is illegal.
One message might be not enough but 2-3 messages should form a “repetitive case”.

And if you own a .ch or .li domain managed by Switchplus, your domain is in danger.

1. https://twitter.com/archiveis/status/956025540028268547
2. https://www.visualcv.com/wolframb

I like that when a page is archived using google, bing, or yandex cache, both the "saved from" and "original" URLs are shown. Could you please add this feature for the cached pages at Exalead and Newslookup? Thanks in advance.

匿名

OK

In the FAQs it says that it has (sic) no sense to archive youtube.. unless you want to archive the title of the video and comments. But why it has (makes) no sense? Videos also get deleted. Isn't information in video format equally important as information in text format? Why not archiving videos also?

匿名

Because videos are huge and archiving them would cost millions.

Are websites, using Let's Encrypt as SSL Certificate blocked? Sites like lbry-io, vc-gg or spee-ch can't be accessed

匿名

It is not related to Let’s Encrypt, just some websites use to strict SSL setings and reject old clients, like Android 4 or archive.is

I hope to upgrade SSL libraries soon.

The machine-translated Chinese is too weird. How can I provide a better translation?

匿名

That would be very nice.

History links for a page used to say "previous" and "next", or something like that. They seem to be gone now? It's a little harder to navigate now (especially with redirected links that were saved).

匿名

There were two problems:

1. they were inconsistent (sometimes there was no next-arrow but actually there was next snapshot).

2. they performed too many database requests degrading site performance.

I home to return the arrows as soon as the problems are solved.

It is not possible to archive linkedin pages -- the browser always redirects. Is this something fixable?

匿名

Fixable. But not quick and easy.

Is it possible to include a link to check if a url can be found in Bing's cache, alongside the links you already have for Google's cache, WebCite, and Megalodon? Possibly Yahoo's cache as well? (not sure if Yahoo's works though) I've found those links you include to be very helpful at times. :)

匿名

yes, Bing and Yahoo caches should work as well.
for example http://archive.is/https://8ch.net/pol/res/10022494.html

9 年前

Hello. Not to sound ungrateful, but will you ever add video or audiovideo archiving? Best regards.

匿名

Unlikely. First, it is expensive, they are huge. Second, it is dangerous (anti)pirate territory I am not familiar with.

Why did you change it so that Google cache snapshots are indexed by the date they were submitted to the archive rather than the date the cache snapshot was taken? The old way was better.

匿名

They are indexed by both (althought there are some bugs as the timestamp in the Google Cache header uses too many formats and languages that I do not support all of them correctly)

Is there a way to donate once instead of monthly/yearly?

匿名

Hm. Maybe by using a card witch is going to expire within the year?

can't seem to archive this link: telegraph co uk steve-bannons-secret-war-room-whiteboard-accidentally-revealed it keeps choking on the domain optimizely

匿名

Fixed

I regularly use your site and I can't access it now. 1005 error. My IP range was banned. Why?

匿名

The only blocked IP range to date was one of bingbot

There is a URL percent encoding problem with '#' and '%23' where it is inconsistent which version works. Sometimes the '#' works, sometimes the '%23'. Would it be possible to recognize '%23' as the same as '#' when determining if a page snapshot is available? I can't post example URLs as the space here limited.

匿名

It is consistent.

The problem is the part starting from # is not send from your browser to myserver, so # is the only char to be escaped. You could escape more using usual functions urlescape() or urlencode(), all of them will escape # (some other chars too, that should be harmless)

Hi! There's some bug with archived newizv-ru pages, almost all text is invisible.

匿名

fixed

Would it be possible to show a feed of recently archived sites?

匿名

http://archive.is/rss

Do you have a HTML code for webmasters who want to use it?

匿名

What do you mean?

9 年前

Screenshot of tweet. The tweet's timestamp says 9 55 AM. The time of the screenshot (upper right corner) is marked 17 51 41 UTC. Are these both the same time?

匿名

Hm, I never though what is twitter’s timezone.

Now it seems to be UTC-7, so 9:55 AM should be 16:55:xx UTC

I know it's already been asked so just to let you know it doesn't seem to be possible to use Paypal still. More of a liberpay issue I guess (the "add money" option only has credit card and bank wire). I'd really rather have Paypal. Keep up the good work..

匿名

Thank you!

just posted a quest bout adding 'new' record using API. Here's the subtext, NYT has this article about wire tapping that appeared online on the 20th, and it changed recently. However, last week I remember coming here and NOT seeing the record in the database(Specifically trump russia wire tap on jan 20th), BUT now I do. Maybe I don't remember seeing it, but sure it wasn't there. Could be huge if they tried to cover up! Bug press for you! :)

netvillagenate-blog

This could happen if you submit http://webcache.googleusercontent.com/search?q=cache:http://example.com (or another cache), then the timestamp from the google cache header will be used.

Can I use the API to add a new EARLIER snapshot record for a site that already has a snapshot? That is, if I have a record on say the 9th and I wanted to add one before that for the 6th, is that easy to do?

匿名

I was going to ask a question (about the software/engine you use). But then I thought about searching through all existing questions / answers at first. So... is there a way to search through them (here)?

sskras

This should work: https://www.google.com/search?q=site:blog.archive.is+something

How do you screen shot part of the webpage further down, and not just the top of the page? When I scroll down the screenshot button goes offscreen so I can't use it to get shots of other areas of the page.

匿名

Technically, no problem. It is too expensive to store full length screenshots.

9 年前

Could you do something about LinkedIn's robot check? LinkedIn used to work great but now always blocked by Google's botcheck/recaptcha.

匿名

I would not call it “work great”: http://archive.is/3UMcH
Even if archive passes the captcha check, it gets a page too slow and heavy to process :(

I archived a page and it shows up in the site search and a Google search, but when I go to click on the link it says "not found (yet?)" as if it was never archived. What does that mean? I distinctly remember seeing the page after it was archived and the search results suggest it was archived, but it just won't show up.

匿名

There is mis-syncronisation with Google index.

If you lost the address of original page and the address of the archived page so Google is the only way to find, that means you’ll have to wait until next Google update

9 年前

People often misunderstand that is the truth in case of archive.
The truth is that the archive software loaded a given webpage at given time and the browser had the content that was stored.
That is all.

It does NOT imply that:

other people who opened the same webpage at the same time have seen the same content. There are a lot of reasons why they might see something different: A/B experiments on the websites, geotargeting, cookies, server-side and networks errors, …
the archived pages contain true facts (otherwise they have to be removed or edited). Hey, there are a lot of archived pages about Santa Claus, should it mean that Santa exists?

is there a problem with the archiving ?

匿名

Hardware fault, fixed

I went to go donate because I think this is a very important service to society but you have no way to send bitcoin. It is very easy to accept and convert to what ever currency you use or just use the btc if your server accepts them. I will donate regularly as long as the community of developers continues the awesome wave of innovation set forth by your team.

匿名

No, thank you. Maybe next year. I have no bills which could be paid with bitcoins and convertion is neither easy nor cheap.

Why does some of the pages that I save not show up when you click the all snapshots from this host button? Also, why doesn't the url count go up when you save a page? I've saved a number of pages and it still says 1..50 out of 804 urls even though that should have gone up a bit from 804

匿名

It is the same why there is at most 1..100 on google and other search engines (804 might look odd, the actual limit is 1000, that means there are 804 unique urls among that 1000).

9 年前

You guys should also get In touch with storj io or some other emerging decentralized storage to back up your archives.

匿名

It is already decentralized

9 年前

Feature request: Keep the same favicons for saved websites.

匿名

But how? There is only one http://archive.is/favicon.ico which is requested for any page.

Why is Pizzagate-related material disappearing from the archive? Did someone ask or tell you to remove it?

匿名

What material? Could you specify urls or domains?

Have your servers really run out space, or are you under attack/gag order by state actors for archiving pages they'd rather were forgotten? Jan 7 2017.

匿名

No, just run out of CPU for the browsers.

9 年前

A. Please look into the new problem archiving facebook pages. B. Could you please set a more flexible donation platform apart from liberapay? It won't accept paypal or bitcoin. C. In recent weeks cloudflare blocks tor. Right now if you fill the captcha then you can access the site, but if you try to archive then you get "Error 504 Gateway time-out" with cloudflare logo. I think you can set cloudflare in a way that would allow tor users who solve captcha to archive again.

匿名

Fixed.

As for PayPal, it should be possible already: https://github.com/liberapay/liberapay.com/issues/424 and Bitcoin is on the way https://github.com/liberapay/liberapay.com/issues/364

Any chance for a simple android app to share url's to in order to generate an archive vs having to copy paste into a web browser new tab?

匿名

https://play.google.com/store/apps/details?id=com.navasgroup.share2archive

If someone was willing to make a mirror/backup/whatever, would you cooperate? Кстати, сколько это в терабайтах?

匿名

It will take few months to copy.

9 年前

Is it possible to feed archive-is a link and get back an archive link, from python?

匿名

https://github.com/SnapshillBot

9 年前

how you make money ?

匿名

There are donations, more than $1.50 every day, enough for a bowl of phở.

It appears sometimes "hide(.)bigmama(.)com/proxy " before the real URL when I archive something. What it is? Thanks

匿名

Some websites are inaccessible from archive’s IPs, resulting in captcha questions or “access denied“ pages. In these cases the archive falls back to using various webproxies.

9 年前

I previously archived an entire website back in the month of November. (You're not letting me include the actual link, so best I can include it is wizardsandwarriorsdotorg.) I checked afterward and the site was archived. But I just looked again and it's gone. It's letting me re-archive it like it was never archived in the first place. What's going on? Why did the site disappear from the Archive?

匿名

http://archive.is/www.wizardsandwarriors.org and http://archive.is/wizardsandwarriors.org are processed as two different websites. You have archived www.wizardsandwarriors.org and then looked for wizardsandwarriors.org

9 年前

Stupid question but, what is my url?

匿名

The address of the page you may want to save. It is usually visible a bit above the content, a string starting with “http“

9 年前

“”“
Estimada/o cliente,
Debido a un error involuntario por al cambio de plataforma el dominio archive.ec fue suspendido, por lo cual el mismo a la fecha fue reactivo.
”“”

Eight days of downtime because of a post-deployment software bug in the domain registry.
What if it were the website’s only domain?

John Navas created an Android app that makes it possible to Share a web page from Chrome (or any other web browser supporting Share action) to Archive.is

You can install it from https://play.google.com/store/apps/details?id=com.navasgroup.share2archive

Since yesterday archive.EC is not under my control. Please update links. There could be parking page or something. And never buy .EC domains

9 年前

Should we be worried that you've started accepting donations? Do let everyone know if you have funding issues.

匿名

Before that people were worried because it was not possible to donate.

Can this tool be used to save fake webpages with the same address as another site? (ex. saving a yahoo article under a huffingtonpost URL)

匿名

No.

9 年前

How can I donate?

匿名

There were a lof of snapshots taken with wrong encoding because the archive’s browser failed to detect the charset properly (example: http://archive.is/je9bT/image). I was convinced that after the chain of wrong conversions it is almost impossible to recover the original text and postponed the problem until the next browser update. This appeared surprisingly easy because of another bug in the browser, which preserves some extra information needed for text recovery. The broken pages are recovered (http://archive.is/je9bT), graphical screenshots are not.

Some bugs could remain (known one is with broken Korean and broken Japanese text on the same page), please report if you spot wrong encoding.

9 年前

We just donated. We did see an odd message "Not active: the donee hasn't filled the identity form". We thought the form had been filled out when we donated, so this may be a bug.

匿名

Just filled. Thank you!

How are you paying for the servers? Are you just paying for them yourself out of pocket?

匿名

Ok, let’s make it transparent.

https://liberapay.com/archiveis/donate - the blue side of the bar is from your pocket and the gray is from mine. There is also few pennies (literally) from ads on XXX-pages, perhaps to delete them would be more profitable than to monetize.

I see you serve archived pages whose links are all 'local' is links that 301-redirect to the actual linked addresses. I'm sure there is some compelling reason for this, it must boost your traffic a bit... pray tell, what was/is that reason? Is there a way to archive a page that will serve it with direct links? I'm asking because I archived a page with many jump off points, and with the 301 delays I'm not sure people would want to use it. Thanks kindly.

匿名

This is just an old bug. Preserving local links is in the TODO-list for more than two years and still not done :(

9 年前

No matter what I do, I get that GD reCaptcha. Every effing time. My system is scanned for malware by Sophos. I use a VPN from Private Internet Access. But no matter how clean, how safe my home network is, your system refuses to allow me in without that stupid captcha. Can't you give me a login or cookie to get around this?

匿名

The captcha is by Cloudflare, it appears before my site enters the game. As currently there is no attack, the security settings is set to the minimal level. Perhaps your VPN neighbour had done something really bad.

9 年前

Could I please either get a login, or could you use cookies, so I don't have to deal with than damn Captcha?

匿名

The captchas is not mine, it is Cloudflare’s. I think, they use cookies to remember you.

9 年前

hi. i was wondering if there is a way to archive a page i can only see while logged it, such as a private subreddit or personal message

匿名

Try http://peeep.us

How do you guys keep the lights on? I gave the donate button a poke, but it redirected me to a fundraiser for a bunch of kittens. (I mean, yeah, kittens are cute, but they don't pay for server uptime, I should think).

匿名

Few $10-20 donations don’t pay it either.

It requires about $3500-4000/mo (only for the servers, not counting worktime, etc).

Maybe some sponsorship or co-branding would go.

IP to go to the storage site. (I do not speak English well.) If I would have saved Twitter web page, my ip is also going to mean Twitter?

匿名

Twitter will log your IP, yes. Archive is not an anonymizer.

9 年前

I am using archive-is for solving dead links. I use curl -I -L to find a usefull memento. Since captcha I get 403 status. Is there a way to log in to the service to avoid the captchas?

boshomi-blog

Please tell me your IP range to whitelist. (I plan to whitelist everything soon, maybe later today, although in case of future attacks it is possible that the security level will be increased again)

9 年前

Why doesn't your bookmarklet work on some sites such as Twitter?

匿名

It is a Firefox bug or a feature. I do not not know to work around it. Other bookmarklets do not work on Twitter as well.

9 年前

Hi there, for the last few days I've been getting a Cloudflare Javascript loop page when trying to access archive-dot-is from the Tor network. The only way to break the loop is to enable cookies from the archive-dot-is domain, which is a security risk as these cookies are tracked by Cloudflare. I understand the site is under DoS currently however Tor users like myself shouldn't be affected as Tor is DoS-proof. Any suggestions?

匿名

Set security=off for Tor (it was =low before). Let me know in case of problems

9 年前

Solving captchas every time I try to archive something/access archived pages is a bit tiring. Is there a way I don't have to do that?

匿名

There was a series of ddos-attacks recently and I had to increase the security level of Cloudflare firewall. I hope to restore the old settings in a few days if no more attacks.

9 年前

I love your archiving function. But I cannot get the bookmarklet button to get one click archiving to work. I've dragged the button to every part of the toolbar and nothing happens. I'm using Firefox 49.0.1. I'd love to have one click archiving on the toolbar.

匿名

It is a bit tricky in Firefox: https://support.mozilla.org/en-US/kb/bookmarks-toolbar-display-favorite-websites#w_show-or-hide-the-bookmarks-toolbar

9 年前

Hello! Some of the urls I'm trying to save are saved in a dark form including an advertisement pop-up like this. Do you know how I can avoid this? Thanx a lot in advance!

匿名

Please, report exact pages here or by email.

These ads and cookie warnings which make the content dark or blurred are to be fixed, but the code cannot do it with 100% accuracy. Sometimes the dark overlay still persist or an important overlay detected as malicious and removed.

Why does one of my browsers get redirected to your fo domain but the other does not?

匿名

You may have “http everywhere” plugin installer in this browser. It rederects to .fo, because .is is blocked in some countries.

Could you add an api to put in requests (and return url) and also to return info on mementos. Alternatively could you just unblock crawlers so we can gather the information ourselves.

匿名

crawlers are not blocked. there was a ddos-attack recently so there could be problems accessing the archive from hosting ips. now it should be ok again.

Re: your blog post of September 14, 2016 (1:43 pm), you can disable captchas for Tor users by whitelisting the "T1" country code in the Access Rules of the CloudFlare firewall. See the ListOfServicesBlockingTor#HowtounblockTorusers page on the Tor wiki and the article "Does CloudFlare block Tor?" on the CloudFlare site.

匿名

Done

If I request an archive of a particular tweet, what local time would be displayed on the timestamp?

匿名

UTC (Reykjavik time)

Please lower the CloudFlare security setting because otherwise a person has to solve CAPTCHAs if using something like the Tor Browser or a well-used VPN.

匿名

It is already at the lowest level (”essentially off“ option)

I HAVE A PRIORITY REQUEST. MAKE A SYSTEM IN ARCHIVE SO THAT ALL SNAPSHOT INSTANCES ARE STORED AND DISPLAYED ON A TIMELINE SYSTEM. EXAMPLE: ARCHIVELINK DISPLAYS SNAPSHOTS OF EXAMPLELINK OVER SEVERAL TIME PERIODS. THIS PREVENTS CENSORSHIP OF ARCHIVES VIA "UPDATING".

匿名

How does it differ from the current timeline (e.g. http://archive.is/http://coccoc.com/) ?

hey this sara gee i like your service my website is crabsnack how can i take snapshort?

匿名

I think this video would help: https://www.youtube.com/watch?v=LK_bp9_ZyQs

9 年前

what is the next sttep should i made once zip file downloaded to my computer? how to run the software please?

匿名

Unzip them and open index.html

9 年前

I can't take twitter's tweet images?(vbyz3)

匿名

try http://archive.li/vbyz3

images are hosted on CloudFlare (using archive.li domain) and it sometimes does not serve them unless captcha is solved.

I know it is a bad issue and I am thinking how to avoid using CloudFlare in the future.

9 年前

The list only shows the last 900 saved pages of a domain. How can I see the oldest saved pages that do not appear in the list?

匿名

you may search for http://domain/a* then http://domain/b* etc

9 年前

please post the ip address to use when the domain registrar screws with you again

匿名

IPs are changing approximately every month. Domains is what make it unnoticeable.

9 年前

why is the site down? I'm concerned about stability lately. Please backup all snapshots you have somewhere, such as the Internet Archive.

匿名

It is not down. why do you think so?

9 年前

Under the 'share' popup. Can you have the short/long links/etc, all match the protocol of the page we're on? It currently always gives HTTP URLs in every field, even when you're viewing a HTTPS version

匿名

This is intentional.
If you are going to share a page is better to use a link which works everywhere, not only in your browser and location.

9 年前

Is there an android app? Or a simple way to share an url from mobile (android) browser and get an archive is url?

匿名

No :(

9 年前

Fewer pages from archived websites show up when I enter the search terms. Websites that had snapshots listed in the thousands now have less than a tenth of that. What's going on? Have the pages been removed, did you change your algorithms, or is there some kind of glitch?

匿名

The search is performed using “Google Custom Search Engine” and similar Yandex’s product. Only the pages crawled and indexed by them can be found (less than 2% of all of the archived content).

Why does not the archive have its own search engine?

It is not a very demanded feature. Google shares the statistics and the revenue from ads above the search results: there is only about $5/mo while new servers capable to index all the archived texts would cost me about $500/mo.

in your FAQ, link for the example for supporting national characters (the Chiense charcter: 测试) was broken could it be fixed? I Hsi-chu

匿名

Fixed. Thank you for reporting!

10 年前

You may have seen talk on Wikipedia concerning whether to allow archive_is links. Archiving prevents link rot in references, & ppl have pointed out archive_is has advantages over alternatives. But there are concerns. e.g. archive_org has a clear model/organization that instills confidence it'll stick around and won't run ads. Wikipedia can't afford to risk linking to a site en masse if it will be filled with ads soon, or if it's not likely to be around for long. Anything you want to add/clarify?

匿名

In my estimation the number of pages cited in the Wikipedia several times bigger than the number of pages saved in archive.is. The number of new links which appear on the Wikipedia daily also several times bigger than the number of stored pages every day on archive.is.

If the Wikipedia would save all references into archive.is (you said “afford linking .. en masse“) this is of course cause problems.

Such activity would not be similar to pressing PrintScreen and save the picture to a photo hosting site. It would become webcrawling and then archive.is would have to obey robots.txt.

This may incur additional costs associated with the purchase of new equipment to cope with the increasing load. If the expense exceeds a certain threshold then the question arises about who pays for it: me, the Wikipedia or the visitors from the Wikipedia to archive.is (any other options here?). In the last case hardly it will be AdSense advertising as archive.is has on the search page, rather an aggressive fundraising campaign. Fundraising is more familiar to the users coming from the Wikipedia because it is exactly the way used by archive.org and the Wikipedia and the expected conversion ratio is higher than from AdSense.

10 年前

Any chance of implementing a "block javascript" option for archiving?

匿名

Could you explain your idea?

10 年前

Any forum that features a picture from imgur. While archiving it will recognize almost any picture that is directly on their site and save it, however if the picture has an url on imgur it won't. In fact during the process of archiving these images will be marked grey, miss file size and lack an identification of what sort of file they are while other pictures will be in the green, feature they byte size and be written as image/gif or Image/png. Mostly on Something Awful forums

匿名

Imgur sometimes (for some clients) redirects from i.imgur.com to imgur.com; from the image to the html page with the same image + ads.

That was the case with the archive, I made a quick fix so images are loaded (example http://archive.is/tNdK2) But I am not sure how reliable it is. I have no idea about how the Imgur’s redirect logic works.

10 年前

Archive won't save pictures posted on forums. What might be the problem?

匿名

What forum?

10 年前

Saving web page seem broken, I tried to save 5 different pages and it return a "blank page" as saved page. Moreover when I look to see ALL archived pages for this (www). (sciencedaily). (com) all recent page most of them are blank page :(

匿名

There is a problem with saving pages from sites behind of Incapsula (a DDOS-protection CDN similar to Cloudflare), such as sciencedaily.com, offshoreleaks.icij.org, monsanto.com, …

They do not ask for CAPTCHA, they just return a blank page for half of requests and even retrying via proxy does not help.

I will investigate it further.

10 年前

Pages at NASA(gov) are not being archived by your service. The pages turn up blank, yet archive (org) is able to preserve them completely. I prefer the archive(is) service, and would like to know if y'all can look into how your service can archive NASA(gov) pages. Thank you very much! Examples of pages being blank: archive(is)/TMOnl archive(is)/yj70L

匿名

I will see, thank you for the report.

10 年前

Google Play Store pages have an expandable description, but right now archiveis doesn't capture the full description, like archiveis/3C6cB would it be possible to archive the full description?

匿名

ok, fixed.

10 年前

Facebook has blocked your account again, please change it ?, because your archiving system is amazing ?, if not consider open sourcing the systems source code ? :) would help alot XD

匿名

ok

Why are URLs beginning with web-archive-org/save/ or web-archive-org/record/ invalid?

匿名

When such urls are requested, web.archive.org starts saving a page, and archive.is starts saving how web.archive.org is saving;

it most cases such race results in pages saved very badly: http://archive.is/xYpxk

10 年前

I have received several bug reports about archive.is saving empty or 404 pages from Google Cache although there expected to be some content.
It seems that there is more than one Google Cache, and what you get depends not only on the URL but also on which one of the Google datacenters serves you request.

Examples of pages saved via different proxies:
http://archive.is/https://webcache.googleusercontent.com/search?q=cache:_PVt8WPb4DEJ:*
http://archive.is/https://webcache.googleusercontent.com/search?q=cache:CO15sF9zSrQJ:*

I think, the archive should perform few requests simultaneously and then save all successful versions.

10 年前

All of 8chan's archives are down. Is there a way to bring this back up?

匿名

There are too much snapshots from 8ch.net and media.8ch.net with child porn.

I see that blocking the whole 8ch.net is not a good solution, but I
cannot review all the snapshots manually.

Any ideas how to separate pages with CP from the rest of 8ch content?

Hi there, I asked about YouTube earlier today. After seeing your reply, I resaved the same URL but the comments are still not expanding. Am I doing something wrong? Here is the archive link... (can't post the link). Thank you :)

匿名

Please email me the link, I will have a look.

10 年前

Hi there. Lately, archived comments posted under YouTube videos are not being expanded to show all comments. I see from your replies to other posts here that they should so I guess YouTube have changed something. Could you please look into this? Thank you for this excellent and helpful tool.

匿名

Aren’t they?

I just checked the last snapshot saved from youtube (http://archive.is/hJu9a) and see the comments expanded.

10 年前

Hey, archiving tumblr posts, can you hit "show more notes" at the bottom of the post repeatedly

匿名

Sure. Compare http://archive.is/0HIzc (before fix) and http://archive.is/PX1P3 (after fix).

10 年前

When archiving Facebook posts, could you please use a script to expand the full thread and thus save an entire conversation? There are several findable with a search for [facebook expand thread]; I can’t include a link here.

jcsalomon

Thread should be expanded. Maybe Facebook changed something in design of there is a bug. Please send me a email with a link of the page.

Let us access the site via raw IP. We'd still use the site as intended and then create third party search crawlers with wtfSEOhax that mine the archives and pump up content to Google. That way you increase the surface for registrar attacks and prevent putting all of your eggs in one basket.

匿名

Raw IP can be attacked as well.

10 年前

1. Regarding the privacy policy of 7 days retention of IP Addresses, does it apply both to viewers and to archivers or is there a difference between viewers and archivers? 2. How do you define the project from your perspective: Donation to the public? hobby? experiment? business? 3. Is it possible that in the future viewing archived pages will stop being free and become pay per view?

匿名

1. Regarding the privacy policy of 7 days retention of IP Addresses, does it apply both to viewers and to archivers or is there a difference between viewers and archivers?

To viewers.
Archiver’s IPs were not saved initially, their saving was added about an year ago. They are saved for finding spam (in SEO sense of this word). For example “indonesian archiver IP and sport topic of the page => probably spam”. The spammers get smarter and such primitive rules became ineffective and I think I will stop record archiver’s IPs soon.
Also note that the archiver’s IP is get passed to the archiving site (allowing them to prepare content based on the region of the archiver instead of the region of my server), so if you concern privacy, use Tor or something like this.

2. How do you define the project from your perspective: Donation to the public? hobby? experiment? business?

I would say all of them.
Also an analytical tool (there are some indexes unavailable to public for performance reasons).
A way to deeply explore an interesting site (http://archive.is/*.example.com tells me more than http://example.com).
A kind of a newsfeed (looking at what people is saving right now is kind of reading a newspaper). I would like to make it public somehow.

3. Is it possible that in the future viewing archived pages will stop being free and become pay per view?

I doubt so.
First, subjectively, it contradicts what the archive does: it cleaned a lot of pages from the hovering ads, paywalls, popunders, prompts to click “like” or pay for the view in some other form. Thus making them “more free”.
Second, I doubt that there are many people (organisations) who can set up the per-per-view monetization of other’s content.
You may recall Scribd.
But there are no others, even the countless Rapidshare clones could not find a billing which can process payments for access to other’s content, they billed for “faster download” and other premium features.
The same applied to AdSense: I believe the account will be terminated and the money frozen.

Thank you for interesting questions!

10 年前

I need to save the full post-timeline of a twitter user, but archive(.)is is only saving a part of it. is there a way to fix this?

匿名

No, the twitter feed is scrolled until archive browser starts working slowly. Too long feed also will be very slow in the browsers of archive users.

I would recommend to save each tweet individually.

10 年前

hey there, I am a big fan of your service. I believe it is very important to have a tool such as yours to capture and review moments of time. Some few weeks ago, your service stopped working for tor users? why? please re-enable it, since I value my privacy and would love not having to surrender my ip for using your service. what happened?

匿名

I do not handle tor users in a special way and did not post any filter on them.

Perhaps, there is some bug or Cloudflare’s anti-DDOS filter tor ips.

10 年前

Domain problems again.

“archive.today” is attacked by fake DMCA and Child Porn requests and may work unstable.

Today OnlineNIC interrupted the service twice based only on private emails with fake DMCA requests and rude wording about how bad the website is.

Can anyone recommend a reliable registrar for a domain with .today extension which will not disrupt the service without a court order? Or it would be easier to drop it and never again have a deal with newTLD? (I talked to Donuts’ VP during the past incident with “Gransy” and got an idea that they allow their resellers (registrars of newTLD domains) to interrupt the service as their discretion. So to say “we do not like you” policy. Thus, an successful attacker must not provide any documents to support her claims, she only needs to create a negative impression and your newTLD domain will be disabled; perhaps few times a day).

Isn't running archive. is expensive? Thank you for providing this free service btw. Why do donations go to a pet rescue fund instead of the webpage capture project? Are they affiliated with each other?

匿名

We are not affiliated. At first, there was a link to WebCite’s fundraising project, but they were not happy with my initiative. I browsed few random projects and chose that pet rescue fund.

Also, I heard that people are more willing to help animals than other people. Thus the donations to a pet rescue fund can be seen as the upper estimate of how donation to the webpage capture project would perform.

If and when archive_dot_is can no longer support its archived materials is there a way users can be notified of discontinued service. Like if something really bad happens financially and archive_dot_is can't be supported anymore will it's users be notified and will there be some plan like move everything over to the waybackmachine?

匿名

Financially there should be no problem. Although, something bad could happen. So consider having a backup at another place.

10 年前

Archive doesn't work for more than 24 hours already. What happened?

匿名

It works. Try another ISP.

10 年前

Ну почему нельзя добавлять форчановские /ХХХ/catalog anymore?

匿名

It should work now.

If does not - please tell me the exact url.

Is it no longer possible to archive updates/changes to a particular URL? Seems like when submitting a particular site to the archive that has been archived in the past, it now just returns the last archived version rather than saving a new copy.

匿名

It should work now.

If does not - please tell me the exact url.

10 年前

The reCAPTCHA on this "Ask me anything" form is quite painful to use. After clicking the checkbox, the upper part of the box (where it says which images you need to select) is cut off by the "Ask me anything" header. I completed it through "Inspect Element", but that's quite annoying. This is on a relatively small display (1600x900, 14") with Firefox 43 on Debian GNU/Linux... I'm not sure if there's anything you can do about it (since it's a Tumblr iframe), but I thought I'd let you know anyway.

匿名

You can use email.

10 年前

Saved pages as zip files cannot be downloaded, when attempted it says "file not found". What is the solution?

匿名

It should work now.

10 年前

Thank you so much for what you do! Question: Any chance of dumping all data you've saved to BitTorrent - or, better yet, IPFS? One ,tar.xz per domain name per year, or something like that.

匿名

This would require 3 times more storage (as the copy would be about 2 times bigger because of lack of the deduplication of the images).

How do you inline the computed styles of every element?

匿名

Isn’t is straightforward?

10 年前

I ♥ "archive today". But have anonymity problem : when I archive some FaceBook pages, adverts specific to my location are included . I've tried stripping back the FaceBook URL to the bare-minimum , and clearing FaceBook cookies, but adverts specific to my location are still included in the archive copy of the FaceBook page. Can anything be done to avoid giving away my location ?

匿名

This location leak is intentional. For example, it allows the sites with weather forecast to target your location, not mine. It you want to hide your location, there are plenty of tools for it (proxies, Tor, Hola, etc).

10 年前

go to deleted site super-chemistry narod ru

匿名

http://archive.is/super-chemistry.narod.ru ?

10 年前

What is the storage total now? Do you ever plan to have a "technical statistics" page to entertain nerds?

jamesthomasmoon1979

I think to write about technical side a bit later. So far there is a big gap between the vision (“how it should work”) and reality (”how does it work“).

Сколько времени хранятся данные url? Максимальный объем хранимой памяти? Это платная услуга или нет?

匿名

Вечно. Бесплатно.

10 年前

Private policy.

There were many questions about the private policy and whether archive.is tracks users.

The website itself does not set any cookies and it does not track user identities (there are no user accounts and no RTB-ads), but:

There is Google Analytics javascript code on the all archive.is’s pages for statistics and downtime alerts. It may track users. A private installation of the statistic/monitoring software is in the TODO-list although not high-priority.
The access logs are kept for 7 days. Sometimes archive.is is used to capture ephemeral tweets or webpages with child-porn and we get requests about them from the police and the regional agencies dealing with child-porn abuse.

10 年前

Hello, it looks like archive is is no longer able to expand Livejournal comments. Ex: archive is TQaZg We ran a sample page through Dreamwidth (an LJ fork) and it still works archive is OLlJq Also when we tried running just the comments we ended up with a blank page: archive is 6NjZz Thank you.

meeedeee

I will check.

Sometimes it did not work due of livejournal slow responses.

The bookmarklet doesn't work on Twitter. I'm using Firefox.

匿名

I am afraid the only ways are:

use another browser
try the Firefox extention instead of the bookmarklet (I did not tested it)

Firefox has in its source code the four domains where bookmarklets should not work: twitter.com, github.com, mail.google.com, reddit.com (but they do work on www.reddit.com)

10 年前

Google Translate is no longer being archived. I used archive-is with news articles after being put through Google Translate. Now pages translated using that service no longer seem to be capable of being archived. Help!

匿名

Fixed!

Thank you for reporting!

You mentioned there's no hot backup as of yet. Just wondering - is it plausible there could be one? Or is the site to big at this point? (I'm guessing it's in the ~5TB range)

匿名

5Tb is weekly growth :)

Images on medium/com are blurry. Because of medium/com dev team made images blurry until your browser focuses on them.

匿名

Fixed.

Thank you for reporting the problem!

I asked that question -where are you located- because you might be located in earth quake area like for example archive org (San Francisco) and then there is a risk that all archiving has no sense...

匿名

We have two copies in different locations (although there is no hot backup yet, and disaster at the location of the primary copy may cause few days of downtime).

10 年前

How do end users know that archived pages aren't doctored or altered?

匿名

Many pages are altered. Main reason is to remove a popup or login box covering the content.

10 年前

Do you ever plan to open-source the software so we can run our own instances?

匿名

No. You may be interested in similar Q&A: http://blog.archive.is/tagged/opensource

10 年前

Is there a new maximum number of archived pages per site? one major site which had several thousand archived pages suddenly has only 1000.

匿名

There is no limit, but when you search for a whole domain, it shows only 10000 latest snapshots from that domain even if there are much more. This limit has been 1000 for short time, I just reverted it to 10000.

10 年前

When the website saves reddit links, does it also save the parts which are not expanded?

匿名

It tries to click on “expand” and to save the version of page with comment expanded. Sometimes, when there are too many expand buttons, page size grows rapidly and the browsers slows down so it cannot perform expand in all the places and some of comments are left collapsed and not archived.

10 年前

Archive I found that needs pruning due to error: E2f3R (the other instances of it all work except this one.)

herecomeskatz

That website displayed the error message and it was captured.

10 年前

Can the thumbnails of websites in the archiveis search results be Retina-friendly? Right now they look really blurry on a MacBook with Retina Display.

匿名

I do not have a MacBook here but I managed to reproduce it on a Samsung tablet.
I did something that makes the thumbnail more sharp.
Please let me know if it helped on the MacBook too.

10 年前

Ghostery doesn't show up anything on the archived version of pages, which is wonderful. Does the archived version remove all the tracking scripts from websites, and if yes, how does it do that? :)

匿名

The scripts are executed when a page is being archived; the result is saved.
To get the idea you may have a look at the mementos of http://time.is here: http://archive.is/time.is
The clock stopped at the time of the capture.

10 年前

Why is the link I'm trying to save stuck on a page saying "#1 in queue"?

匿名

The server was overloaded with too many submissions from tweetsave.com :(

Is it possible to have an archived page presented without the header at the top? And maybe an option to only show the webpage option? It would be great if this option could simply be added to the URL (e.g. append something like this to the URL ?noheader=1)

匿名

What is the goal ?

To embed archives into pages on other websites (like youtube videos) ?

When I archive links from Reddit and Pinterest, the output looks poor , often times. Can anything be done about that?

匿名

Can you provide more details in order to locate and fix the bug faster ?

Which links, what is your browser, what is poor?

Were you affected by that? Title of article I can't link: Twitter shuts down 30 sites dedicated to saving politicians' deleted tweets

匿名

I guess no.

Archive.is does not use Twitter API and I was unaware about it until your question.

10 年前

Sent you a mail regarding translation but no reply. Should I send it again?

匿名

Replied.

Sorry, gmail put your message in the spam folder :(

Could you make the short URLs into 301 redirects to the full memento URLs, like other URL shortening services do? Short URLs are good for users that have to type them manually, so they're useful in the 'share' section, but 99.9% of people just copypaste and shortened URLs are unfortunately 200% opaque. wikipedia bans URL shorteners for that reason.

匿名

I do not think it is the right time to introduce the redirect as it may break the full-text search function which is still powered by Google Custom Search.

In the share section you can get both the long url and the short url as well as the template for Wikipedia which retains the original url and the archive timestamp.

Why have you blocked finland? I like your service. Its good while i want sometimes download some sites into a .zip file for my archival. Could you unblock finland please?

匿名

Please consider using other services.
You are not welcome not only by your source region but also by abusing the service designed for humans, not for the bots which submit urls and download zips.

Is there a way to link to the most recent archive of an article by including the URL in an archive. is link?

匿名

http://archive.is/newest/http://reddit.com/

There is also http://archive.is/oldest/http://reddit.com/

How can I test if a page exist in archive and obtain the short url

匿名

Open http://archive.is/

Enter the url of the page into the dark blue form.

Press Enter.

Have you considered creating a browser plugin for Firefox/Chrome. One which allows you to right click any link & choose to instead open the archived page using your website. If the page is not already archived on your website, then it would first archive it & then send the user to the archived page. Many users do not wish to support "clickbait" websites, by having this functionality you allow them to deny support to those websites. Other benefits include quicker checking of the archives.

匿名

It would be more effective to ask the authors of the existing plugins (no one of them is made by me) to add this feature.

Does the archiver use a Blink-based browser? YouTube images are served as WebP, not JPEG (fACRv).

匿名

..and it makes them invisible in Firefox. You are right.
Fixed by recoding archived webp images to png.

How can I change the translated text? It's google translated and it SUCKS.

匿名

I would really appreciate if you suggest a better translation! Please, send an email to webmaster@archive.today

Why do YouTube video collection pages not show the full history of a user's videos? Can't you submit the "load more" query when archiving and download more so that the history of videos shows up on the archived page? Example: Z5mBE

匿名

Fixed, http://archive.is/fACRv

The [I'm not a robot] reCAPTCHA is very annoying when asking a question. It makes it hard to ask questions. Sometimes it shows up within the comment box but the top and bottom are cut off! I have to use Firebug to make one of the enclosing elements much bigger by giving it a height! Some of the images are very hard to make out too. It is hard to pick the street signs when some of them are blurred out! It also times out too quickly too.

匿名

It is made by Tumblr, not by me.
You can always use email to ask questions.

Are there any limits on the number of URLs a user may submit each day? The FAQ is silent about this, if there are limits.

匿名

There is no explicit per-user limit.
There are some performance limits derived from the limits of the hardware: for example, the number of running browsers is limited and the queue size is limited.
They are very rarely hit, but the user willing to submit tons of urls has good chance to hit them.

So the data of the snapshots archive is gdok1, archive is AlnJe and archive is hUfRf are all saved seperately, while their webpage capture and webpage screenshots are the exact same? Could you check if its the same before saving a double copy? Then you don't need the 'If this snapshot looks obsolete you can save the page again.' alert.

匿名

1. same pages like in your example are very rare. ads or block of recomedations or feed of tweets differ.
2. it might take considerable time to make a hidden snapshot to compare the previous snapshot with; also this operation may fail due to network conditions or server error.
3. for some usercases it has sense to same exact the same page twice, to proof that it has not changed.

Is there deduplication of the data on the archive? What if two snapshots of an url are the exact same, do you save it twice on disk?

匿名

Images are deduplicated, htmls are not. There are too many images which are the same across thousands of snapshots; for example, the icons of the social networks

10 年前

Could you remove the German Google translate translation? I'd rather see the site in English than in bad German.

匿名

Could you help the free project and improve the translation?

Alternatively, you can change the language: http://www.w3.org/International/questions/qa-lang-priorities.en.php#changing

When will the index scheme be updated to accommodate more than 10000 URLs listed in each search?

匿名

I plan to index the whole archive using elasticsearch and use it also for url-search.
No exact date yet.

Answer this already with absolutely no bullshitting, lying or talking non-sense: what is the real reason for blocking Finland and when will you unblock it? If answer to previous question is "never", how can ANYONE trust this site anymore?

匿名

Presumably, never.
My view on the trust issue is different: it is better to sacrifice the global availability a bit (it is far from being 100% anyway) than to censor the content.

The site cant archive PDF links, is there a way to allow it?

匿名

Not yet.
You can try archive.org, webcitation.org or scribd.com.

Few hours ago, an user found XSS vulnerability on both archive.org and archive.is.

Page https://archive.is/VSGzW saved from https://archive.org/search.php?query=1XSS&sort=-publicdate<svg%20onload=confirm(/XSSPOSED/)> contained executable javascript.
The bug is fixed.

You are blocking Finland based users. Not so smart to punish people for with you think is government based excuse of yours. And we do have F-Secure Freedom and lot's of proxy's on the web. You are not so smart with this move you made.

匿名

It seems I just created a good page to buy the F-Secure ad-space :)
There is also Opera Turbo, for free.

10 年前

If you end up blocking tor, only block archiving not viewing archives.

匿名

In case if the number of abuses increases it may end up in pre-moderated submissions from Tor .
So far they are post-moderated with special attention to ones made from Tor IPs.

It can be both slow and fast, but it still fit for that guys needs. You won't block Tor right? Can't imagine that many wikis that are blocked in Finland but he still has his VPN if he needs it. On the other hand Hola might get your real IP blocked in wikis and other websites when other users abuse hola acting as your IP adress.

匿名

No, I do not block Tor.
Although there is a good reason to block it - child pornographers make copy of theirs websites (which, as they correctly predict, disappear soon) - there are some users who take care on their privacy: those who store defaced websites, etc.

10 年前

Warning about Hola, stay away from that software because it makes you an exit node for other people. for more info. google "adios hola". If you need to reach a blocked website use Tor browser.

匿名

It is slow and Tor exit IPs are banned on many websites.
And you cannot edit wiki using Tor.

10 年前

Hi, do you know why archive got blocked in Finland? People (including me) cant access archive and instead are getting a message on screen stating that the website is forbidden to be used in Finland. Even when using a VPN service like ZenMate I have not been able to bypass the block. Is there a way to fix this?

匿名

Try hola.org

10 年前

please restart the service. since yesterday I get only timeouts.

匿名

could you provide more details about the problem?

could you expand youtube comments, both the comment-too-long "Read more" link and the "View all 2 replies" threads of comments?

匿名

Like this https://archive.is/0MrWK ?

Hi. I'd like to give your site a good rating on mywot, but I cant find your privacy policy. This is a legal requirement, please add one / show a link to yours on your homepage.

匿名

Could you please try another argument for its usefulness? So far the proposal to host some foreign legal document looks like a bid to get a tattoo in an unknown language.

How do I find the hashtag of a selected region of text?

匿名

Can you add a note that you pass along X-Forwarded-For: to the target sites in your FAQ? It seems worthwhile for full disclosure regarding privacy. Thank you.

匿名

ok

GET request for archiving web sites would be nice. Web Archive has this feature: web archive org/save/{URL} works easily. (I had to change typing url, because of, tumblr doesn't allow urls) I use archiveis because of it has more sophisticated features than Web Archive. Thanks for this nice tool.

匿名

GETs are disabled to prevent the crawlers (such as Googlebot) from making submits.

So I wanted to archive a page it asked me if the one form 2 yrs ago was obsolete I put yes only cuz that one looked completely different from mine. My actions didn't alter someone's previous archive correct?

匿名

yes, old archives are not altered.

Thanks for the outstanding service. I'm building a stand-alone archiving tool for "Web 2.0" pages which is heavily inspired by your approach. I know you mentioned repeatedly that the codebase is not useful out of context and I understand that, but I'd like to ask again just for the Javascript components, which are the ones that would be the most useful and portable, but also the trickiest to get right without iteration. Any chance I can reuse the website-specific plugins and/or the inliner?

匿名

Ironicaly, the JS part is the most useless one and not portable, it requires PhantomJS with many patches applied.

I almost completed chrome extension for you. I will release in a few days. Then I'll remind you.

匿名

Thank you!

Is there any way to donate directly to the site? I went to the donate page, and it took me to a charity, but I'd like to help out with costs incurred by what I imagine is a hefty increase in archiving over the past... oh, say 10 months

匿名

There is no way.
I do not know how to arrange it.
Accepting credit cards would require the incorporation and the accounting (this is costly, perhaps more costly than the expected amount of the donations).
May be Bitcoin is a solution?
Also you can support WebCite here: https://fundrazr.com/campaigns/aQMp7

can you make the long, full memento URL for an archived page more prominent and copyable? the URL that goes /20150626003414/ whatever

匿名

ok, done.

if you have an idea how to design it better (I do not like the present solution), please, let me know.

Why the project isn't open source?

匿名

The codebase is far from the point where the open/close-source difference may even have sense; it is not in the form of a re-deployable product; besides the html standards (and big list of exceptions) the code reflects specific hardware and network, which pages are popular, the behaviour of the SEO-bots and the users (in order to tune the caching strategies), etc.
It would be a big work to create an alienable archiver (whether open or closed source) which anyone could set up on their own premises.

what the heck - this is awesome. Who is running this? Why? Who's paying? How much does it cost? Why isn't everyone using it? How do I know my stuff is not going to disappear one day? Can you make a chrome plugin so I can save archived pages -- just like you archive them, the best way -- into Google drive, ensuring that I have control of them?

匿名

If you have control on Google Drive, you must have control on Chrome Team as well; why do you ask me to make a Chrome Plugin?

You wrote that a page can be rearchived "At least 2 hours after the last submussion". When I tried three and a half hours after, it failed i.e. it delivered the previous snapshot. Id would be great if you could fix this. Also it would be grate if you can fix the fact that an archive operation that returns a previous snapshot rather than make a new one as requested, there is NO ALERT to the user. If he does not spot the old time, he is left unaware that the output URL shows a different snapshot.

匿名

Can you provide more details about your URL (may be by email) ? Actually, there are some conditions with the delay much bigger than 2 hours; for example if the submitted URL ends with .png or .jpg. If it is not the case then it must be a bug.

About the alert it would be a good feature, thank you.

I archived a page containing a video. I can't read de video. What did I do wrong? Many thanks. J*

jtoile

Videos do not work, sorry.

Is there any way to force the site to save an updated version of a URL that has already been archived once?

匿名

Yes. At least 2 hours after the last submussion. There used to be 5 min threshold, I increased it because of many submissions performed by broken bots and some urls (with static content!) were submitted thousand of times every 5 minutes. I understand that it is not convenient for thouse whose who would like to archive dynamic content so I am looking for a better solution (perhaps the white list of the sites which are updated quickly, such as twitter)

Some pages which load content only after the user scrolls the page do not get archived fully. For example, most of the articles on Salon com

匿名

Do you mean “loading comments“ below? Scrolling does not help here :-( I will investigate it.

If possible, could you make it so that CSS3 gradient backgrounds are rendered in the snapshots? Compare: archive is w8xM0 with archive today a4phI fdaaaf46db144d06c6788f6b524fb01e85ffe787 png.

匿名

My browser is quite old.
“background: -webkit-linear-gradient(cyan 0%, #E5F 100%)“ is supported but “background: linear-gradient(to bottom, cyan 0%, #E5F 100%)“ is not, it is too modern.

I have an FM radio news program with a website that relies on Archive-is to store primary resources for our listener audience to study. We archive pages that may be deemed "politically incorrect" but are used to show what the subject of a news story believes. Can we be re-assured that no political content will be erased, even 'historical revisionist', communist, anarchist or islamic pages? Thank you!

匿名

Sure.

how can I see the videos in an archived site

匿名

You can not, unfortunately, videos are not archived.

Archiving imgur albums doesn't show the images.

匿名

Thank you for reporting the bug. It will be fixed soon.

What happened to the links to Facebook and such?

匿名

Please provide more details about the problem. Nothing was changed.

Can't save from NYTimes, wget doesn't "push" the button for the full article. Got a fix for that?

匿名

Can you tell me the exact URL with this bug? I am unable to find it

The new Google Maps interface displays a big dialog in the middle of the archive. Could you please update your archiver to close the dialog?

匿名

Ok, fixed.

Thank you for the bug report!

Why did you change the URL back from archive-today to archive-is? Archive-today is a better name and URL.

匿名

I see two problems with .today: it is longer and the URLs are not clickable sometimes:

If there would be many users who prefer .today, I will change it back.

Archives of trademark case details pages from the UK Intellectual Property Office are faulty. They show blank. It would be great for this to be fixed.

匿名

url?

Would you consider handing over all the captured data to the Internet Archive, if you were to close down? They would likely make it publicly available.

匿名

Not sure if they will make it publicly available, looking at how they handle robots.txt (for instance, compare https://archive.is/www.chillingeffects.org and http://web.archive.org/web/*/www.chillingeffects.org).

And I am not closing down.

11 年前

Are archive-today, archive-is and archive-li (replacing the dash with a dot) the only domains used?

匿名

yes

Some pages like this one, 6TROi, are framed such that they have horizontal scrollbars that make it hard to read the page. Is there anyway to capture the page, or have it presented so that the horizontal scrollbar is not present?

匿名

I took new snapshot of this page (https://archive.is/F3Jxu) and it fits well with no horizontal scrollbar.

Can you clarify how I get a page archived with text selected? So for instance on KdxNr I had Seattle selected when I used your bookmarklet, but it certain didn't get captured with Seattle selected. How do I add on the selections after a page has been captured?

匿名

http://blog.archive.is/post/95383347266/hi-i-use-firefox-17-linux-and-select-some-text

I had an idea for a useful feature that could be added when "download zip" feature is used. I am running into an issue where zip files downloaded from archive-today are not trusted as they can be tampered with, but sites on archive-today itself are trusted. Would it be possible for archive-today to sign the archive with a gpg key when it is generated, and provide the user with the sig in addition to the zip? Then the integrity of the archive could be verified by checking it with your public key.

匿名

It is not easy due to the paradoxical fact that the snapshots are not stable enough. They are changing over time with the changes in the post-processing code.

If you compare https://archive.is/Ho3nb/image and https://archive.is/Ho3nb you may notice that the former has the popup with warning about the cookies but the latter is not.

At https://archive.is/Ho3nb you may notice that the images embedded in tweets (which are cropped on twitter.com until clicked) have their full height on the snapshot. As the snapshots are not interactive we have to make little changes in the webpage layout in order to make semi-hidden content visible without requiring action.

One more example: at https://archive.is/53wIp the transcript is shown as though “READ TRANSCRIPT” button has been clicked.

All this magic is performed by the post-processing code. What you see and what you can download in .zip-files are the output of the code. Every change in the code would change the content and the control sum of all the .zip-files and would require all the .zip-files to be signed again.

Yesterday I did not disclose the page which «Gransy s.r.o» was willing to remove in order to avoid unnecessary Streisand Effect.

Here (copy, copy) «Gransy» is answering the questions of their fellow Czech hosters and, although not saying that directly, tries to make suggestion that the page in question is somehow related to the childporn abuse (of course, as any webpage from the Internet can be stored on Archive.today, child porn abuses can happen and do happen, although they unlikely can reach attention of the Registrar or ISP, as we asked Horká linka to send child porn abuses directly to us and they do).

The page in question has nothing to do with «child» nor with «porn» nor with «abuse», it is https://archive.today/gabrielle.be (exactly this page, not the snapshots listed on it).

The very fact that «Gransy» is not apologizing but defending itself dropping gentle hints to the childporn abuse displays that the threatening with blocking the domain was not a mistake of a fresh hired employee from the Level-1 support but the established business practice: they even have a special slang shortcut «bububu» for it.

The domain registrar «Gransy s.r.o» (AKA «regtons.com» AKA «subreg.cz» AKA «regnames.ua») was threatening us with blocking «archive.today» domain if some webpage were not removed from «archive.today» website.

This page is not related to Wikileaks, nor to the Gamergate controversy, nor to the war in Donbass. Not even to the copyright. They wanted to remove the snapshot of a deactivated LGBT-clothes shop.

We can only guess why the «Gransy s.r.o» employees consider this case so important - against the background of all the hot controversies that use «archive.today» to preserve the proofs which many people want to disappear - to renege on registrar’s neutrality and arrogantly use such a dirty method as threatening with blocking the domain in their intention to censor the client’s website content.

I have moved «archive.today» to another registrar.
Also mirror on «archive.is» is still active and I registered «archive.li» where I am going to set up an additional mirror.

Web typography is getting popular, how will this site take an accurate image of the page?

匿名

Custom fonts are archived with the page.

11 年前

I was going to suggestion something but I can't explain it without showing some urls, and this form appears to block submitting a message containing URLs. Kind of silly since its related to a service dealing entirely with URLs, no?

匿名

You can send me an email.

You should allow users to send cookie strings to send in the headers of sites you request with the bot. That would allow people to make captures of pages that require authentication/session of some kind.

匿名

I tried and failed.
The problem is the authentication cookie are ‘http-only’ thus the javacript executed when you press the bookmarklet button cannot read the cookie.
So you would have to obtain the cookie using the sniffer or another inconvenient like that.

You may want to use http://peeep.us/, it can store the pages which require authentication.

Can't submit anything now. It says "Server Error".

匿名

fixed

Hi. I have a plenty of bookmarks which I would like to archive before they become dead links. It would be an unreasonable amount of work to archive each page manually. Is it possible to do it automatically? I will watch your blog for an answer.

匿名

It has been answered several times, please, have a look here http://blog.archive.today/archive

Not a question. Just a thank you for this website. You're helping people to gather proofs of things that may be deleted by shady people. Thank you for that.

匿名

I notice you retweet lots of gamergate stuff. I think you should try to appear neutral in all these big internet arguments if you can. Or maybe I'm overreacting.

匿名

I retweeted sample usages of archive.today.
Yes, there are a lot of gamergate-related accounts among the reweeted sources.
But I do not watch closely the gamergate, have no opinion on it and do not understand which side of the confrontation took each of the retweeted accounts.

11 年前

is that possible to pass parameters such as username and password to generate the pages? I mean, there's some news websites who doesn't give complete access until you log in and I have proper generic accounts available to use for snapshots.

匿名

Can you tell me what are the sites?

Archive.today does login into some websites (using own username/password). It is possible to handle other sites likewise.

What should happen if, for some reason, you have to shut down the archive. Would you provide the ability for people to your entire archive? Say, through a set of torrents sorted by domain alphanumerically? Or would that be unfeasable?

匿名

Then I will need to maintain the server(s) to seed the torrents.

Hello, Do you have a link for donation directly to archive today project? (not the HELP Animal Nation campaign on fundrazr)

匿名

No, there is no direct donations.
I do not expect the direct donations would cover the expenses required to set them up (separate accounting, taxes, etc)

Would it be possible for you to unfold comments on journalfen net (it is a livejournal fork).

meeedeee

It is possible but not so easy as adding a new domain next to Livejournal and Dreamwidth.
The unfolding is done by clicking to “expand” links which Journalfen lacks.

Why is the list of archives for a specific domain limited to <10000 unique URLs?

匿名

This is the limitation of the current index scheme :(

>> Could you please add some type of time zone indicator next to the time stamp?> All timestamps are UTC (the time zone of Iceland and Liberia). Then could you please add that timezone indicator? Otherwise the new reader just has to guess.

匿名

ok

Could you please add some type of time zone indicator next to the time stamp?

匿名

All timestamps are UTC (the time zone of Iceland and Liberia).

What kind of content is not allowed to be hosted in the archive, if we take images out of the equation? For example, is archiving text-only articles about stealing, shoplifting, lockpicking, and other activities allowed?

匿名

So far there has been only one issue with the text content: publishing of drug production recipes is illegal in Russia, so we received a request from the government agency to hide them from visitors from Russia (otherwise they would block the whole site). Visitors from other countries can see those pages.

Is it possible to archive a website as viewed from a different country? Some websites tailor their content to the region and thus produce results written completely in Dutch when acessed through Archive Today. For example, IGN automatically redirects to the Dutch edition of it's website. What if I would like to archive the American version? Or the U.K. version?

pawtiko

As a quick fix I can do if for some sites (the U.K. version of ign.com should be archived from now on, just to test), but making this option available to the users is not so easy - the servers in different countries must be constantly monitored, etc.

Anyway, it is interesting feature to add.

There is another reason to have it: some websites in Asia and Latin America works too slow for the clients in Europe and because of it I see many broken snapshots with partially loaded pages. Launching the browser in another country, closer to the website, could be a solution.

Are you aware that whenever text is selected in any linked page that location is saved to the browser's history. This makes navigating away from the page using the back button extremely annoying and eventually becomes impossible as, in chrome at least, there are only so many pages cached to go back to. Is this intentional or have you just not noticed it?

匿名

I did not notice. Fixed. Let me know if you will find any bug.

Why don't you use a proper identifying user-agent string in your crawler?

匿名

It is proper, it reflects actual version of the browser engine.

In case if there will be something like “Archive.today/1.0”, some sites would return SEO-optimized version of the page intended for robots and not for people. It may lack design and images at all.

If I archived a page earlier today, but now don't remember what it was, is there any way to retrieve it?

匿名

That is the problem. I do not know.

11 年前

How long are pages stored?

匿名

Forever

11 年前

archivetoday seems to be broken on product hunt.

匿名

https://archive.today/www.producthunt.com ?

What is broken?

Do you have a mailing list for people like me who want to be notified about important updates to your project? I am willing to make occasional donations to archivetoday if need be, and if you have a mailing list or other way of notifying people if you ever need help, I would like to sign up. Archivetoday is a great service you are providing to everyone, and I thank you very much! :-) Regards, Robert, Colorado USA

匿名

Thank you.

There have not been updates few years, only current fixes.

I will write here or in http://twitter.com/archiveis if there will be something important.

Just to let you know that I think wall street journal have figured out a way to block your archiving since your site no longer works with them.

匿名

Do you mean https://archive.today/www.wsj.com ? It seems working.

Your website's down. Statement?

匿名

It happens :(

I plan to run a live replica in another DC.

Are you using the Common Crawl Corpus?

匿名

No.

What for?

11 年前

are some IPs blocked to reache your site?

匿名

Almost all ovh’s and online.net’s IPs (and one small netblock in Poland) are blocked because of a lot of hungry crawlers.

Great site! Have you thought of using skimlinks or similar to replace affiliate links / affiliate codes with your own, or at least to block out advertising? This is a great way to both monetize the archive and protect the privacy of your users from the website owners whose content has been archived.

匿名

Clicks are tracked, and as I see, people do not click on archived ads at all.

Some ads are removed: 1. popups which hide the content; 2. slow ad servers and ad servers with too heavy javascript (which slow down browser’s job too much) are banned.

What do you mean as privacy issue? Could a long url under the banner reveal something about the user?

11 年前

How much storage is archive today using currently?

匿名

~200Tb

11 年前

Hi. It used to be possible to archive Google SBI (Search By Image). But now we get "502 Bad Gateway" (Archive ID: SrAAA). It's an important link because it's impermanent and it documents the growth of Google AI. Yet it seems singularly disabled as if on purpose.

匿名

Looks OK now.

Perhaps is was a temporary network issue.

Do you preserve archivers' privacy? E.g. not disclose the source IP address?

匿名

Yes.

But take in mind that when you archive a page, your IP is being sent to the the website you archive as though you are using a proxy (in X-Forwarded-For header). This feature allows websites (e.g shops or the sites with weather forecast) target your region, not mine.

Could you implement md5 displaying of archive zip files? Even if the page is deleted just display what md5 it had before it was deleted?

annerajb

Content (and so MD5) could change. Currently, the only reason for the cnange is removing ad or login popups which hide the content. As the algo is evolving the content you see on archive.today and in zip files could change. The pages which currently have a popup tomorrow may have it hidden. Another reason of change would be fixing of invalid HTML, some pages have invalid HTML (e.g <li> not surrounded by <ul>).

Are you still working on the archivetoday project? Please let me know. Andrei m15816 at gmail

匿名

sure

11 年前

Large sites' comment sections and even sites like Indiegogo are moving to AJAX-based content pulls where the site relies on client-side code to retrieve central content, both to limit bandwidth (e.g., scroll-based "See more") and quite possibly to frustrate server-based website caching tools like ArchiveToday. As this technique goes from 'prevalent' to 'dominant,' how do you see ArchiveToday adapting to it?

noseson-blog

It scrolls some known sites (twitter, facebook, vk, …) in order to load more. On others (livejournal, reddit, ..) it clicks on “see more” or “expand comment”

Let me know if you need to handle more sites like that.

11 年前

Hello, the zip files for archived pages are corrupt. Please fix this issue. Thank you!

匿名

Which exactly? I tried some of them and found no corruption.

New archives do not appear in any list since November 27.

匿名

There is some maintenance process is going on, if will finish in 1-2 days.

Which language and libraries do you use to archive websites and if you could rewrite your code which languages and libraries would you choose now?

匿名

Scala, Javascript, Go.

I would try to use Yandex’s Elliptics instead of Hadoop as storage backend; it should better handle big failures, for example, whole datacenter outages.

Is there a way to archive this page w/o the annoying popup that prevents us from reading the archive? After clicking to remove popup, the page redirects to original URL (which might be changed or gone). Thanks. archive: 5VHBC

匿名

Sure.

We try to remove the popups which hide the text (compare http://archive.today/5VHBC/image and http://archive.today/5VHBC) but the algorithm is not 100% accurate.

Thank you for reporting the bug.

Your service has been used by Julian Assange in his book When Google Met Wikileaks. Please try to get your database encrypted and distributed, and ensure that somebody can release the key to it, should you be forced into silence or otherwise censored.

匿名

11 年前

I would like to run my own web capture service instead of relying on a third party service I have no control over. Is it possible to install this on my own server ? Do you have any plan to share your work under an open source license ?

匿名

No. But you can find some similar open source projects on github.

Not really a question more of a comment. The isp xplornet is actively filtering archived sites, just thought you'd like to know.

匿名

Virtually every archived link I try to visit fails to load, can you explain why?

匿名

Can you provide more info about the problem?

can i save threads from closed groups?

匿名

No.

You can use www.peeep.us for this

I try to archive a page but I get Error: Assertion failed.

匿名

It can happen when one tries to archive PDF-file or MP3-file or RSS-feed or something like that.
If your page was a normal one, please tell me its url.
It could be a bug.

is it true that archive,today is going to be purged?

匿名

No
Why do you think so?

11 年前

Hi there, I have heard that some material related to the GamerGate controversy in the gaming world has been removed. Can you give me any details on what your polices are on removing material and who might have requested this? Thanks a lot

匿名

Hi.

I have never heard about “GamerGate” controversy and I have not received any related deletion requests.

Do you log IP addresses of who archives, and subsequently views pages?

匿名

No

Did something change with the code in the past week? Downvoted reddit comments no longer show up.

匿名

try again, it must work now

Can I see how many times my archive has been viewed?

匿名

No

Hi. I use Firefox 17 linux and "select some text on the page and get URL with hashtag referring to the selection" does not work. Am I doing anything wrong? Load page, select text, use bookmarklet.

匿名

You should select text on already saved page.
Use bookmarklet, get snapshot, select text on it, copy url with hashtag from the address bar.

will you delete some pages if government of Russia will ask you about it? there is disgusting issues with censorship nowadays and they try to hide some information from people and to force sites to cut off whatever they want even without a decision of court.

匿名

We hide some pages about DIY drugs. You have to be outside of Russia (or use a proxy) to see them.

Why do I get aeoioiouou characters instead of Hebrew on www_fresh_co_il?

匿名

This is a bug. I will fix it soon.
Thank you for reporting it!

UPD: Fixed

How can I get a new capture of a page that changed since already captured today?

匿名

Submit its URL again.

What's the point of this when the Internet Archive is already out there with the Wayback machine (which is far more complete)?

匿名

The difference is under the hood: wget vs. (almost) full browser engine. It allows to handle some pages more accurately.

11 年前

I've got problems with saving Soundcloud pages.

匿名

fixed

Even if you don't want to make public your source code, I would like to see some GNU project like yours, so anybody can save and zip any webpage. I know there is MAFF extension on Firefox, but a PHP project would be great. I don't have any coding knowledge, but I know how to run a forum or a WAMP. Another great service is HTTrackOnline-eu an online service similar to the windows freeware "WinHTTrack" but it's not open source. May be you can get inspired and publish something similar. Thanks! :)

匿名

Hi. Instagram fails to archive. Presumably due to their content protection. Example: q4pkK.

匿名

Instagram engineers were faster than me in fixing this bug :)
Now must be ok.

We love using archive today to create snapshots of comments in blogs like Livejournal. One of archive today's better features is when it unspools or expands all the comments so that you can capture an entire discussion. Would it be possible to do this for Dreamwidth, a blogging platform that uses much the same code as Livejournal?

匿名

OK.
It must work now.

Can I archive pages from a password-protected blog?

匿名

No :(
But www.peeep.us can do it.

12 年前

Hi, I know you use phantomjs to download an website, but how ? What command do you use ? Can you give me a sample generated .js file ? Please ! :) . When we download a website, we see all the request, how do you echo that ? Thanks

匿名

Something like:
====
page.onResourceRequested = function (res) {
console.log(JSON.stringify(res));
}
page.onResourceReceived = function (res) {
console.log(JSON.stringify(res));
}
====

Is there a way to see a log of the requests and redirects used to get the page?

匿名

No, it is not stored.

I have archived a page, and would like to archive it again since the content has changed. Will the new archive override the original one, or will two separate snapshots exist?

匿名

Two separate snapshots will exist.

12 年前

I accidentally created an archive today page, thinking it was a live site, and tried to key-in my login and password (which show as asterisks). Of course, it did nothing. Do I need to worry about the security of my login information? (by the way, I can't find the archive today page that I think I created - so this may be a non-issue)

匿名

Form submission is disabled in the snapshots and all scripts are removed.
It is safe to enter information in the fields, nothing could be sent to the Internet.

12 年前

Some years ago I wrote about twenty articles about electronics in knol. This plataform later dissapeared, and now I'm posting the articls to a new place, which is "max-iskram" in an openshift server. I found the old refrences in archive today, and I would like to fix the addresses in order to redirect to the new site. Is that possible?

匿名

I do not like the redirect idea, it would not comply with the idea of archiving snapshots of old pages.
It seems that the problem is that the snapshots of your old pages are shown in Google and your pages in new place do not?
I submitted request to Google to remove the snapshots from the index, it should help your new pages to appear there.

12 年前

What do you think about the discussion currently on the Administrators' Noticeboard at the English Wikipedia? These people are making baseless claims and allegations against you, without any firm evidence. Some of these people are not allowing anybody to use links to your site on Wikipedia.

匿名

I think archive.is better fits needs of small amateur wikis and forums than big players like Wikipedia or Stack Overflow.
Wikipedia could buy an enterprise archiving service (e.g. pagefreezer) for 50-150k$/year. It is only 0.1-0.3% of their annual expenditures.
I cannot provide higher level of uptime and support, even for money.

Hello Archive, could you provide an option to spoof the Archive Robot user-agent? I would like to archive the mobile version of some websites but I can't get it with the current mechanism. Thank you.

匿名

It is not easy, PhantomJS allows to spoof User-Agent only for the request of the main page, not for the images and AJAX requests :( So you may get something weird instead of the mobile version.

Will you one day publish your code and put it under an GPL or BSD or similar license?

匿名

I think no. Actually the code need to be rewritten from scratch, it is very ugly :)

archiveis doesn't seem to detect the domain of an internet archive image if the date is proceeded by an underscore (i.e. 201310924_ or 21389471845im_), can this be fixed?

匿名

Fixed.

All the digital images on the page archived is not showing when on the website, it still visible. Did I did something wrong?

匿名

One of the servers (img.archive.is) was down, it should be ok now.

Is it possible for you to provide a facility to search the archived pages through the text they contain?

匿名

Yes
https://www.google.com/search?num=100&hl=en&safe=off&q=site%3Aarchive.today+word

12 年前

How bo you drag that butteb down to the line

匿名

Like this: http://www.peeep.us/pages/howto

12 年前

Do you plan to stick with the new archive-dot-today domain long-term? Or is it likely to be a temporary domain for the service?

匿名

This is difficult to plan. The system of domain ownership is very fragile, it has weak points (mostly human factor) which can be attacked.

If you are concerned which domain (archive.is or archive.today) to use in the permanent links, I would bet on archive.is, which is redirecting to archive.today and will redirect to a new domain in case of problems with archive.today.

I paid to join extreme privacy have received a user name and password but there is no member place to enter everything I try takes me back to to pay again and payment already through my credit card??? What to do

匿名

Hi. Our website is completely free, it does not accept payments and it does not send username and passwords.

Curious... Why the move in domain names from archive,is to archive,today?

匿名

ISNIC (the .is domains registry) is being attacked by social hackers so I am about to lose the domain archive.is
You may want to check my twitter http://twitter.com/archiveis if you are interested in such news.

what is "Template Error: The template file must be given (or the template could not be opened)"? Does this mean the website is defunct?

匿名

It means there is a problem with configuration: http://www.linuxspy.info/tag/template-error-the-template-file-must-be-given/ You should write to the webmaster of that site.

12 年前

What has caused the Archive-is site to go down today?

匿名

There were some technical problems, sorry for that.

It will be back online in 2-3 hours.

No data is lost.

When did the Archive-is site originally launch?

匿名

May 2012

12 年前

Hey, is there any way you can make it so that entire Twitter threads can be saved? I've noticed that you can save user pages for up to "3 scrolls", but only the first "page" of content is saved for a Twitter thread. The archiver doesn't bother to scroll past it. (sorry for clunky wording, unsure what proper terminology to use)

匿名

It should scroll the page until twitter website stops responding.
Sometimes it happens too early.
I will investigate this issue.

were do the links in "linked from" come from?

匿名

They are links to the pages on the community sites where the original (or archived) page was cited.
I found them useful to understand the context of each of the archived pages.

12 年前

Why don't you allow webmasters to remove their sites? The duplicate content can harm the original sites.

匿名

It is not the reason to delete page from the archive. Reports about SEO collisions are forwarded to Google and Bing and the reported pages should disappear only from their search index. It takes few days. Sometimes it does not work well. Please try to report again or write to webmaster@archive.is

12 年前

Your archive doesn't seem to work with Instagram posts for some reason, is there a reason for this?

匿名

It is a bug, it will be fixed soon.

Does archive-is has IP segments for stationary use? Why not add a characteristic likes "ArchiveIs Bot" into user-agent info?

kopisee

Most of the requests are performed from the segment 144.x.x.x.

Some modern websites would answer with the bot-optimized web pages, assuming a bot is unable to process a modern page. That pages may look far from user expectations.

Regarding bulk archiving... Is the "url" field the only parameter that one has to POST to the "archive,is/submit/" location, or is their any other field data that needs to be submitted also?

匿名

Only one

I see that you implemented expanding of livejournal comments. That's great! But for some styles it's working incorrectly, for example for [kungurov livejournal 76137 html] archived page is one of the subthreads with one comment (redirected to). Could you please fix it?

匿名

Done

Great web service! Am I able to do an AJAX POST to the submit url ( archive,is/submit/ ) and have it automatically archive a webpage without needing to click submit? If so, what POST variables would I need to include with the request to have it process properly? Thanks! :)

匿名

There is no AJAX, just plain old <form> with POST.

You can make the same request using curl

http://blog.archive.is/post/45031162768/can-you-recommend-the-best-method-script-so-i-may-batch

Does "Archive is" have API?

匿名

Yes

http://mementoweb.org/depot/native/archiveis/

Have you think of accepting Bitcoin donations? It can be anonymous and you won't have to deal with banks. I think it fits your needs perfectly.

匿名

I do not have bills to pay with bitcoin.

Hello... wow many posts and I didn't know... I'm following it by now hope to receive email when something new is said... ALLRIGHT I got a question... do you have / or plan to a "bulk optioin"?? Say I have 500 links I'd like to archive... doing it one by one is something I keep posponing... Kepp the good work this is a great and simple solution that will keep getting popular for sure!!

qrackerjackquake

Yes, it is possible

http://blog.archive.is/post/45031162768/can-you-recommend-the-best-method-script-so-i-may-batch

Would you consider upgrading archive to support TLS 1.2, instead of TLS 1.0 as it currently does?

匿名

Check again, it should work now.

Are there any bots that archive the externe weblinks in the Wikipedia automatically with archive_is? I ask because I see so many archived sites of these links, I cannot believe this is made by human.

匿名

There was a wiki bot for this. It had been blocked in English Wikipedia few months ago but the snapshosts it has made are still here. And the bot is still working for non-English Wikipedias and other Wiki-projects (e.g. http://lurkmore.to, http://wikiislam.net, etc)

12 年前

Thanks for your site! Why should I use archive_is over webcite? The probability that webcite will stay long in the net is bigger.

匿名

If you use both, the probability will be even closer to 100% :)

There are some URLs only archive.is can save (e.g. pages from facebook) and some other URLs only WebCite can save (e.g. PDF files)

12 年前

Do you have any plans to add SSL functionality to Archive,is?

匿名

It should work now

SSL... Quite important these days, especially since it is cheap & easy to setup. Important because, as already said, any government, isp, or capable adversary could man-in-the-middle modify/change the archived pages, effectively rewritting history. They could also more easily leverage your site to inject malicious scripts or other code into the returned pages to abuse users. And it is a privacy issue for users of your site, because the exact url & query is exposed, allowing 3rd party tracking.

匿名

12 年前

Actually, using TLS is *always* a good idea if you can afford it. Archived content might be public but what about queries? They should not be considered so. And besides, how otherwise can we be sure that reply wasn't modified in transit? Right now malicious actor can rewrite archived history without anyone noticing. Idea that only passwords and cookies are worth protecting might have been (somewhat) justifiable in pre-Snowden era, but I'm sure that by today most people realize it's not enough.

匿名

12 年前

Why no SSL connection privacy on the Archive,is site yet??

匿名

What would be the reason for SSL connection to a site which has no user accounts (not even cookies) and which content is fully exposed to everyone ?

12 年前

So your expenses increased from around $300/month a year ago to $2000 a month ..how does it comes ? This should be a real burden for you, is there a way for us to donate ? keep up the good job

匿名

It has much more visitors than a year ago: https://siteanalytics.compete.com/archive.is/

No, I do not accept donations. They are not “free”. Someone has to do the accounting, someone has to make ads to encourage people to donate, etc. You’ll be impressed by checking which part of their income the donation-driven NPOs spend to their “fundraising teams”.

You may want to donate to a similar project: https://fundrazr.com/campaigns/aQMp7

You said that the maintenance costs of the website are around $2000/mo. Did you consider cloud services like AWS/Google Cloud/Microsoft Azure etc.?

匿名

Cloud services are much more expensive and less flexible.

12 年前

Who use your site?

匿名

People who suspect the webpage they cite can disappear.
For example
Authors of books: http://archive.is/ajD14
Authors of academic papers: http://archive.is/pzvY0
Bloggers: http://archive.is/Sn2yB
Twitter users: http://archive.is/chUa4
Users of social sites, such as Hacker News and Reddit: http://archive.is/UoLgp
etc

12 年前

How much does it cost you to host a website of this size?

匿名

About $2000/mo

12 年前

I wanted to congratulate you for taking such a major initiative - maintaining something similar to the web archive/internet archive. This is a mammoth repository! Hats off to you! What do you intend to next? Any new feature, functionality?

routebyroad

Switching to a newer WebKit is a long-awaited feature. Some other features (such as PDF and Flash support) depend on it.

Hello... I had the opportunity to receive excellent support from admin... very fast and clear!! I would like to ask, since this is what this is intended for hehe, if you plan to use the content of this blog to make a better-complete FAQ?? GREAT WORK I'M TALKING ABOUT THIS TO MANY FRIENDS... THANK YOU!!

qrackerjackquake

Yes, the blog became a better FAQ than the FAQ, they must be merged eventually.

12 年前

Have you ever heard of "documenting history"? That's what the site is for, enough said.

匿名

12 年前

Interesting concept, but I'm not quite sure I understand the goal. I happened to run across a single page - my "Welcome" page from 8 July 2013 - which I did not request, but apparently SOMEONE did? ...but it also says "no other snapshots from this URL." I have about 8,600+ individuals & 3,800+ families plus numerous sources, images, etc. amounting to more than 13,000 "pages." The data - the raw GEDCOM - is about 17.5M, & the images are about 1.1G, so I can "save" everything more efficiently.

匿名

I agree, it is suboptimal to use archive.is to store structured datasets. They can be stored in less space and with better search facilities.

12 年前

What does it mean if I try to save a page and it says "Network error"?

匿名

Either there is no connection to the target server or unsupported type of file (PDF, XLS, .. or RSS/Atom-feed).

I cannot reliable distinguish between these two kinds of error :(

If sites have been saved from other archives, which archives have they been saved from?

匿名

http://archive.is/webcache.googleusercontent.com
http://archive.is/peeep.us
http://archive.is/hghltd.yandex.net
http://archive.is/www.youdao.com/cache*
http://archive.is/www.sogou.com/websnap*
http://archive.is/www.webcitation.org
http://archive.is/www.family-source.com/cache/*
http://archive.is/hl.mailru.su
http://archive.is/cache.baidu.com
http://archive.is/cache.yahoofs.jp
http://archive.is/nova.rambler.ru
http://archive.is/cc.bingj.com
http://archive.is/blekko-webcache.com
http://archive.is/wayback.archive.org
http://archive.is/megalodon.jp
http://archive.is/hiyo.jp
http://archive.is/arquivo.pt
…
The list is not complete, because archiving is initiated by user requests. And they can archive any URL they like, even if I am not aware of that website.

Almost all of these snapshots are indexed using both URLs.
For example, this snapshot - http://archive.is/sa4Uo - taken first by arquivo.pt in 1997 and then re-archived in 2013 on archive.is, can be found by both the original URL: http://archive.is/http://www.lusa.pt/impreg/impreg/12MAR97/not0158.html and the URL or archiver: http://archive.is/http://arquivo.pt/wayback/wayback/id742788index5?pos=1&l=pt&sid=CFA9EE0F6FBB9DC227425C893349A213

hashbang URL not working: archive is hWzY6

匿名

Yes :(

You can use http://archive.is/hWzY6#27% as a workaround.

I saved a page but when I went back to view it there is nothing except:

Not Found (yet?)

匿名

“Not found (yet?)” is shown for not yet allocated short urls. So it seems that you have made a mistake typing the url.

12 年前

How far back do archive pages on this site go, i.e. what is the earliest archive of a webpage hosted on this site?

匿名

Spring 2012.

But there are some pages re-saved from other archives and they are definitively much older.

12 年前

¿Tiene algún plan para ofrecer versiones de su sitio en otros idiomas?

匿名

si, pero necesitare a los voluntarios para la revisión ortográfica :)

Why are adverts sometimes placed on archived versions of pages where there are no adverts?

匿名

Perhaps that advert were intended to be shown only in specific countries (e.g. European or francophone) so you did not see it but the archiver did.

12 年前

Why do some web-pages take longer to archive than others?

匿名

There are many things the loading time depends on. Number of elements on the page, webserver and network issues.

Also, some webpages load images and scripts from more than one server, and the slowest server sets the total loading time of the page. Even if that slowest server is needed only for something insignificant like social buttons or ad banner.

12 年前

Is there any way that I can save video, from a site such as YouTube, along with the page when it is archived?

匿名

No

Once I archive a page, how long do I have to wait before I can archive the page again, if the content has changed?

匿名

5 minutes.

All submissions within 5 minutes timeframe redirect to the previous snapshot instead of taking a new one.

12 年前

Is this a non-profit organization? If so, how can one donate money to it?

匿名

No.

You can donate to a similar project WebCite here: https://fundrazr.com/campaigns/aQMp7

Is this database mirrored in order to help maintain long-term stability and accessibility?

匿名

Yes

12 年前

Given that you're not happy with the source as it currently stands, would you be able to provide an api-like service? Ideally I'd love to be able to shoot off a URL, and get a ZIP package back. I considered just submitting URLs and grabbing the link at the end, but that seems rather abusive to your server.

匿名

You may want to use any of open source tools:
http://code.google.com/p/chrome-scrapbook/
or https://chrome.google.com/webstore/detail/singlefile/mpiodijhokgodhhofbcjdecpffjipkle?hl=en
or https://chrome.google.com/webstore/detail/pagearchiver/ihkkeoeinpbomhnpkmmkpggkaefincbn?hl=en

Also, Microsoft Internet Explorer can save pages in .mht format and it can be easy automated with any scripting language (much easier than any other browser).

About the API…
It looks like providing a private service so I must ask, are you ready to pay for such a service (something like $1 per 1000 shots) ?

Can you give an option to download webpages in .7z, they are much more efficient than zip.

匿名

There is only one well compressible file in each archive (html), the rest are png and jpg images which are already compressed and the archiver keeps them untouched. So the choice of the archiver would not affect the resulting size of archives significantly.

Also, many new unpackers (7z, rar, …) are able to unpack zip-files, but not the other way around.

12 年前

I noticed that you support a download link for pages that have been archived. Would it be possible to support downloading a page in WARC format?

匿名

It is possible but I am afraid it would not add the value you expect from WARC.

Archive.is’ snapshots are not result of the crawl but snapshots of the internal browser state.

So there is almost no metadata and even the original URLs of images are not stored (moreover, some of the images were not downloaded at all but produced by rendering complex WebKit-specific CSS sentences in order the snapshot could be simpler and less dependent on the browser of the user).

Can newspaper articles from behind a paywall be archived?

匿名

Only those which either have “happy hours” of free access or registration-free access to all articles but limits the per-day or per-month number of articles to see.

Those which always shows “enter you credit card” instead of articles - definitely no.

12 年前

Hi, The following hashbang URLs not working: archive is /RcaO0 Won't webpage capture automatically go to the section concerned? Thanks.

匿名

this is a bug, thank you for reporting! Not all original hashbangs are preserved :(

If you want to share a link pointing to a specific part of a long page, you can use specify the percentage in hashbang, e.g. http://archive.is/RcaO0#84.4%

For how long will this website and the archives be available, how many people maintain this project?Thank you.

匿名

Forever. Actually, I think, in 3-5-10 years all the content of the archive (it is only ~20Tb) could fit in a mobile phone memory, so anyone will be able to have a synchronized copy of the full archive. So my “forever” is not a joke.

Two persons, currently.

Webcite has a comb feature where we can archive the links on a specific page. This comes in handy for some of my research papers. Is there an equivalent way to do this with archive. is?

meeedeee

Not yet.

You are the first person asking for this :)

Can I create a user? I want to know what url I have saved?

匿名

No.

You can create a collection of your archived paged on http://delicious.com/ or http://pinterest.com/

12 年前

sin querer no di permiso para mi microfono y camara ,, necesito que se me habilite el permiso para utilizar webcams

匿名

necesitas navegar al websitio original para usar la multimedia de la pagina

12 年前

your website has a list of personal identifying information (PII) including credit card info; who do i send legal correspondence to?

匿名

You should contact the issuer bank to ensure they have the cards blocked. Banks can be found by the prefix of the card number (http://en.wikipedia.org/wiki/List_of_Issuer_Identification_Numbers).

12 年前

where these information is saved. How can I retrieve a page that I have saved from my system?

匿名

You can download a .zip file (there is a link in the header).

12 年前

The Internet Archive and Webcite avoid copyright infringement prosecution because they have an automatic "opt out" feature which your site does not (see wiki/WebCite#Copyright_issues). Aren't you concerned about some major organization or corporation suing you or getting you listed as an international copyright pirate and your door smashed down in the middle of the night and all your computer equipment conficated? I'll understand if you'd rather consider this privately & not post it.

匿名

It is difficult to use archive.is for pirating due to limited size of the page it can save. Of course, it is still possible, by UU-encoding a movie or windows.iso and then by splitting it into small parts. But there are plenty of convenient tools to do that, for example, the torrent trackers or mega.co.nz. Or even The Internet Archive and WebCite, because they can save big binary files.

Archive.is now supports Memento API and Firefox plugin

Can your spider be stopped in a similar way as IA Archiver: "User-agent: ia_archiver Disallow: /" Thank you.

匿名

There is no spider (as a machine which takes decisions what to archive).

All the urls are entered manually by users (or taken from https://en.wikipedia.org/wiki/Special:RecentChanges, where they also appear as a result of user edits).

If the archive would check and obey robots.txt, then, if archiving is disallowed, the error should be seen to the user, right?

Then, on seeing the error, the user will archive the page indirectly, first feeding the url to an url shortener (bit.ly, …) or to an anonimizer (hidemyass.com, ..) or to another on-demand archive (peeep.us, …), and then archive the same content from another url, thus bypassing the robots.txt restrictions.

So, this check will not work the same way as it works with IA Archiver (which is actually a machine which takes decisions).

13 年前

Where may I download the API/Source code to this site?

匿名

It is not open source. May be I will release the current version as open source after switching to a newer one.

About API: you can submit a page by issuing a HTTP request with any suitable tool like curl or wget: http://blog.archive.is/post/45031162768/can-you-recommend-the-best-method-script-so-i-may-batch

It you need a more complex API, to perform searches, get answers in xml or json, etc, just let me know, I will implement it or find a way how to it.

Congrats for keeping this as a free service, this a very useful site. You said in your blog that this cost you $150 to $300 a month with more than 10TB of saved data. I'm just curious how do you manage to get this, considering that any reliable cloud hosting is around $0.1 per GB per month ?

匿名

cloud hostings are overpriced compared to prices of dedicated servers and to collocation own hardware(an extra 3Tb disk costs about $200 and it will serve you a few years)

13 年前

It seems that Twitter feeds with a lot of tweets (500+) are not fully archiving, archival attempts seem to get stuck on a page with the loading spinner still displaying. Can this get fixed by increasing a time-out value or something?

匿名

This is one of the problems I plan to fix by updating the web browser core (may be in a week or two).

The one which is currently used is quite old and has obsolete and slow JavaScript interpreter. Long Twitter pages causes consuming of gigabytes of RAM and 100% CPU. I do not think increasing of timeouts would help - there is a risk of the browser gets stuck forever or crashes because of out of memory.

13 年前

Your service is awesome! Is it possible to donate? The one thing I feel is missing is a feature for archiving pdfs. Perhaps it's a manual or a terms of service I'd really like it if there was an independent copy that could back me up.

匿名

Hi.

You can use webcitation.org to store pdf.

Pages from reddit.com will be saved with all comments expanded

Before the fix: http://archive.is/0gmIN

After the fix: http://archive.is/eRCSv

what happened to the site?

匿名

it works for me (and for many others as well)

13 年前

Added “download .zip” function

13 年前

You have typo in FAQ: “It there any limit on the page size ?” should be “Is there (…)”. kthx.

匿名

Thank you

13 年前

what is the name of the archive is robot?

匿名

It used to be “archive.is bot”.

Now it impersonates as a regular browser, because some popular sites (instagram to name one) try to detect if the page was requested by bot or human and in the former case can show the ugly version of page which is optimized for bots, not for people.

13 年前

Is it possible to get the source code of this tool?

匿名

No, it is more a set of hacks than a project.

But you can find similar open source projects, for example https://github.com/gildas-lormeau/SingleFile/

What software is used to make the actual snapshot? (I wrote a personal version of this which uses wget -p -etc, which is less than ideal on js-heavy pages)

匿名

http://phantomjs.org/ with some patches.

Can the archived pages be downloaded for local use on our computers? Will you be releasing the software that you use for archival?

匿名

1. In browser’s menu: File -> Save As -> Compele page.

Anyway, adding something like “download as .zip” can make sense, for example for mobile users which do not have full featured browsers. I will add it.

2. I think, no. It is very tricky to run, it depends on an exact version of Chrome, which binary also must be patched in order to reduce security (to allow saving content of frames, etc).

I tried to archive some pages yesterday and today (2013-03-16), but I always got: "Error: Network error." It seems to be the same with different target sites. I had also tried with addresses targeting my own server here and had the same effect, while I and others could reach my server that way. Looking at my logs, I did not even find an attempt to connect to my server from this site (archive is). What is wrong?

匿名

Thank you for reporting, the problem was on my side.

Should be fixed now.

Hey! It's a great resourse. Is there any possibility, that my bookmark will be removed? It's not porn or anything, but i'm not sure about copyrights :)

匿名

To increase reliability and be more confident, you can put your link to all the archiving sites, not only to http://archive.is/ (there are also http://peeep.us/ http://webcitation.org/ http://hiyo.jp/ http://megalodon.jp/ ).

13 年前

Can you recommend the best method/script so I may batch archive about 7000 urls?

匿名

something like

curl –data url=http://url-to-submit.com/ http://archive.is/submit/

Please note, that it may take up to 1 hour to process 7000 urls (after you submit them and before they will be visible on the site).

Does archive have plans for an API? Just curious. =)

newhopegriffin-blog

What kind of API do you need?

If I archive my web pages on your site I assume that the search engines will not say I am a spammer because my material appears more than once on the internet.

匿名

They should not. As far as I understood, SE spamming is about spreading links to a site, not about copying the content.

13 年前

Any plans to provide an API or open source the code? This would be a really helpful addition to many of the bookmarking tools.

jasonfredin

The site supports OExchange (http://www.oexchange.org/), so the bookmarking tools can use it.

You refer to the wonderful Wayback Machine. Have you had any discussions with the Internet Archive? Would you be interested in integrating your cool service with theirs somehow?

匿名

No, I hadn’t any discussion.

But I’ve heard some rumors about their plans to use real browsers to execute javascript, etc.

13 年前

You said u like the idea of sharing the data your site has collected. Seed it via torrent ;)

匿名

Currently all data is available via http.

Isn’t it enough ?

13 年前

The current homepage shows a box from which you can submit a link to be archived (which works really well, by the way). However, I think it would also be a nice idea to allow looking for previous snapshots of a web page by entering the address at the home page. (For example an extra button that says "find saved copies".)

匿名

Yes, the new design (which I hope will be online soon) will have this feature.

For a while, you can check if the page was saved by querying URLs like
http://archive.is/http://www.google.com/ - all snapshots of the exact url
http://archive.is/www.google.com - all snapshots from the domain
http://archive.is/*.google.com - all snapshots from all subdomains

How can I delete an archived page?

匿名

Write to webmaster@archive.is

Currently there is no automated way to do it.

And it is not so easy to implement as it might look, because a lot of archived pages are referenced from Wikipedia or other wikis. The deleting of a page should be somehow synchronized with fixing those references on the wikis. Otherwise, if would be ridiculous if the site which goal is to fight the dead link problem has dead links itself.

13 年前

What motivates you?

no-chair-design

I needed something like this for my personal use and have not found one (yes, there is WebCite but it could not save the pages I wanted to save, like Google Maps and Twitter).

Some useful features are still not implemented though :(

13 年前

So, if you say it costs you money - how much is it?

匿名

It is difficult to calculate the exact balance, because the servers are used for other projects as well. The last bill was ~700 euros, so I’d say archive.is costs 150-300 euros/months.

13 年前

Just a quick question. If you already have more than 10Tb, how are you paying all of that ? If I see well, there is no ads or stuff like that.

匿名

Yes, I pay for it.
I do not think it is correct (or even legal) to put ads on the pages created by others.

But another model of monetization can appear eventually.
For example, pay accounts with the ability to manage private bookmarks and do full text search, etc

13 年前

How long my snapshot will be stored? I have in mind the case when it has not been accessed for a long time.

匿名

Forever.
Although the snapshot may be deleted if it violates the rules of the hosting provider (for example, if the page contains pornography or used as the landing page for spam campaigns).

13 年前

What will happen to the data when you shut the site down (eventually)?

匿名

I do not plan to shut down the site.

But I like your idea to have backup on a 3rd party public site in a form that anyone can download, say, a zip file with any snapshot. The only problem is: there are more than 10 terabytes of the data and growing quickly.

is it safe?

匿名

sure!