Version 1.6.2
A Vodafone Group R&D Lab
Welcome luca to Vodafone Betavine |  Sign Out | My Account | Help

 
Home Downloads Forums Developers About Us

Projects

Highly rated projects on Vodafone Betavine

SunsetGPSLogr Icon

Automates the creation of GPS trail data..

Kaz..


BrowserVodafone Icon

WebBrowser Vodafone

nogueirapl


SunsetGPSLogger Icon

Automates the creation of GPS trail data..

Kaz..


QuitmateME Icon

Quit Smoking Application for the Mobile

griffo


CryptoGraf_MG Icon

CryptoGraf Messaging. Send Message Keep Secret. The Best Security to Encrypt Mobile SMS and MMS.

CryptoGraf


GPSPhotoTagger Icon

Free GPS Photo Tagger..

Kaz..


DrugArranger Icon

Health

Shawn


Nimbuzz Icon

Instant Messaging and voice over ip mobile application

manupeco


KaywaReader Icon

QR Code and Datamatrix Reader

Roger


Sketching Icon

Mobile version of the good old Etch a Sketch (trademark by Ohio Art Company)

Kaptein


 

Forums

Categories » Mobile Internet Content Adaptation » Rationale behind changing the User-Agent header?

Threads [ Previous | Next ]
nigel

Rank: Alpha
Posts: 8
Joined: 9/14/07
Rationale behind changing the User-Agent header?
9/17/07 7:04 PM
Dear Brian et. al,

I know this has been repeated and talked about passionately in other threads. But all discussions inadvertantly gets deflected to a discussion about W3C standards, which is non-existent and beside the point. As a developer who has years of experience developing mobile content, I've seen a lot of interference (or screw-ups) by carriers. But none is so bad as to changing the mobile phone's User-Agent. So I would like to ask a question, point blank:

What is the rationale behind changing the User-Agent header?

Please do not mention W3C because the standard does not exist. Vodafone is the one doing it, so please answer as Vodafone. Don't act as if a standard already exists.

I do understand and actually somewhat appreciate your efforts to automatically transcode desktop websites, if what you say about increasing mobile web usage is true. The more people that are used to browsing on the phone, the better for the ecosystem as a whole.

You already provide publishers a way to tell the WTE not to transcode, some are based on standards (mobile web sites should send the proper Content-Type and DOCTYPE anyways). I do applaud the effort.

I am trying to think from your standpoint here. The one thing that I do not understand, is why you have to change the User-Agent. I would like you to also think from the standpoint of mobile website publishers.

Sites that are desktop-only will serve largely the same desktop content, no matter what the incoming User-Agent is. These sites can be transcoded by the WTE. These site owners may have no problem having their site transcoded, because by definition, they don't care to adapt their content to mobile devices. Even if they do detect the User-Agent for desktop browser capabilities, they probably don't care too much about browsers that are not PC or mainstream. In this case, what's the point of faking as a different User-Agent, as sending the phone's User-Agent will largely yield the same result?

Sites that adapt their content to mobile phones rely on the User-Agent to identify the incoming device. Adapting their content to specific devices are their bread and butter. By faking as a desktop PC, Vodafone is effectively fooling these sites, telling them to return desktop/non-adapted content, and have WTE ruin their carefully engineered and crafted markup and user interface specifically targeted to various mobile phones. Some of these pages may contain carefully placed ads, so money and revenue for these sites are at stake. Is there any wonder that you are incurring the wrath of all these mobile publishers? In this case, it is of course better off for everyone involved if you just leave the User-Agent alone.

So it seems to me that changing the User-Agent is pointless and harmful, from a technical standpoint. Telling us to read from a different header is completely beside the point. (Besides it is not a standard!) It just creates unnecessary inconveniences for mobile content publishers that should not be there in the first place.

Unless, well, you create the inconvenience for reasons other than a technical one. I won't go down that path just yet, and I want to hear what you have to say.

So, tell us, what is the rationale behind changing the User-Agent header?
luca
Admob.com
Rank: Alpha
Posts: 14
Joined: 9/6/07
RE: Rationale behind changing the User-Agent... as a reply to nigel.
9/17/07 7:32 PM

Brian, they want you to come here and sing your song about how wonderful this amazing new vodafone adapting technology is once again.

Luca
spuggy
bluetrail
Rank: Alpha
Posts: 1
Joined: 9/17/07
RE: Rationale behind changing the User-Agent... as a reply to luca.
9/17/07 9:41 PM
Hi

Just for the record and to log the point that this is causing pain - the content adaption did screw up our download provsioning and caused client phone calls.

Guess we should be on the ball and monitoring the blogsphere more :-)

I can't imagine another part of the IT industry where this could happen.

Richard Spence
Bluetrail
mrbgturner
Vodafone
Rank: Beta
Posts: 25
Joined: 8/2/07
RE: Rationale behind changing the User-Agent... as a reply to nigel.
9/19/07 9:22 AM
Hi Nigel

I do take on your points here and thanks for your time in writing your detailed blog. You wanted a direct answer.

Vodafone is offering a PC experience to customers.

The desktop user agent string is sent primarily to get desktop internet content vs. mobile pages, not to get desktop content vs. nothing at all.

Well known desktop sites offer mobile versions because they know that most phones can’t handle their full site.

But with the WTE, all of these (WAP2.0) phones now can access their full site.

We cannot guarantee content return by sending the mobile user agent. I do accept your point that many sites will return the content. Some will not and this is the topic of the W3C group on "blocking sites".

You mentioned that you didn't like the discussion being diverted to standards but that is the way the mobile industry works.

Future standards and recommendations are needed not just on this point but on Content Adaptation as an industry. There are many issues from user agent to content control to new business models.

The topic of "Mobile User agent use" is not "closed" by Vodafone by the way.

We are having a lengthy debate on just one topic.

Vodafone will be listening to the recommendations in this area. If the recommendations consider different usage of the mobile user agent we will consider those but they have to make sense in this new world of html and wml content.

I have stated many times that this area is not exclusive to Vodafone and over the next six months you will see more activity from others.

We have heard the strong views expressed on this site. That is the point of the site, to allow a constructive voice to be heard and consider them.


BR
Brian
luca
Admob.com
Rank: Alpha
Posts: 14
Joined: 9/6/07
RE: Rationale behind changing the User-Agent... as a reply to mrbgturner.
9/19/07 11:18 AM
mrbgturner:

Well known desktop sites offer mobile versions because they know that most phones can’t handle their full site.

But with the WTE, all of these (WAP2.0) phones now can access their full site.


not true. You know better than me that adapted web sites deliver a poor user experience on feature phones.

mrbgturner:

We cannot guarantee content return by sending the mobile user agent.


...so vodafone prefers to cheat to get content which the original content author did not mean to be served that way. Not very ethical, is it?

mrbgturner:

You mentioned that you didn't like the discussion being diverted to standards but that is the way the mobile industry works.


What are you talking about? Vodafone is blatantly ignoring standards, just because it is in the position to do so technically. Are you expecting us to buy this story? you can't be serious!

mrbgturner:

I have stated many times that this area is not exclusive to Vodafone and over the next six months you will see more activity from others.


In this case, developers will be there to tell them to stop "polluting" the ecosystem.

mrbgturner:

We have heard the strong views expressed on this site. That is the point of the site, to allow a constructive voice to be heard and consider them.


well, all the voices say the same thing. Leave the user-agent string alone. So if you wanted to hear a voice, now that you have heard it, you can only do one thing: stop messing with basic mechanisms of the mobile Internet.

Luca

jalberto
Cellectivity
Rank: Alpha
Posts: 3
Joined: 9/18/07
RE: Rationale behind changing the User-Agent... as a reply to mrbgturner.
9/19/07 11:41 AM
Vodafone is offering a PC experience to customers.


So what you are saying is that Vodafone users will not be allowed to download music, video or mobile games from sites that have not been expressly white listed by Vodafone. As that is what the users will confront if accessing such sites from their PCs.

I presume that you understand that when a user pays real money for a game to download to their mobile, they actually want a version of the game that works on his/hers mobile and not the PC version.

Will Vodafone accept the liability for people paying for incorrect content for their devices? Shall vendors advice their customers to ask Vodafone to refund any moneys that were spent on incorrect content? Certainly it is not the vendor's fault as it is Vodafone the one interfering with a lawful commercial transaction based on the accepted standards and protocols of the Internet.
miha
Mobitel
Rank: Alpha
Posts: 3
Joined: 9/12/07
RE: Rationale behind changing the User-Agent... as a reply to mrbgturner.
9/19/07 12:49 PM
mrbgturner:

The desktop user agent string is sent primarily to get desktop internet content vs. mobile pages, not to get desktop content vs. nothing at all.

Well known desktop sites offer mobile versions because they know that most phones can’t handle their full site.

But with the WTE, all of these (WAP2.0) phones now can access their full site.

We cannot guarantee content return by sending the mobile user agent.


Brian, I gave several recommendations to achieve same if not better experience on the "I want my UA back" thread, and I got no replies to that. I will restate some of them here:

* the way I understand, you want to deliver "desktop web" to your *mobile* user, regardless of what the site OWNER wants to deliver?

* you can not guarantee content return from mobile UA? Well, you can try, and if it fails, you can ask for it again with the WEB UA.

* you could employ logic in your WTE, that if users "mark" the site as mobile-aware, you could let the mobile UA through for ALL FUTURE requests, i.e. and have a self adapting technique.

* and, of course, as others mention, you intentioanlly brake all unlisted content download (ringtones, wallpapers...) mobile-aware sites.

Regards,
Miha.
jalberto
Cellectivity
Rank: Alpha
Posts: 3
Joined: 9/18/07
RE: Rationale behind changing the User-Agent... as a reply to mrbgturner.
9/19/07 2:59 PM
But with the WTE, all of these (WAP2.0) phones now can access their full site.


I do not want to be throwing conspiracies around. But given the fact that users are paying per kbytes, it seems to me it is much more profitable for Vodafone to force users to receive a 200KB WEB page than a 20KB WAP page.

That wouldn't be the reason behind forcing WTE no matter what? Or is it?

So do this phones support FLASH, PDF and all the other content types supported by the PC browsers? Can I run applets and all the other embeded windows objects on them?

What kind of experience do I get on such sites?
atrasatti

Rank: Alpha
Posts: 6
Joined: 9/11/07
RE: Rationale behind changing the User-Agent... as a reply to mrbgturner.
9/19/07 5:04 PM
mrbgturner:

Vodafone is offering a PC experience to customers.

The desktop user agent string is sent primarily to get desktop internet content vs. mobile pages, not to get desktop content vs. nothing at all.

Well known desktop sites offer mobile versions because they know that most phones can’t handle their full site.

But with the WTE, all of these (WAP2.0) phones now can access their full site.

We cannot guarantee content return by sending the mobile user agent.


Sorry Brian,
but I think this is not the right reason for hiding the user-agent string.
In my opinion the content owner knows best what he wants to serve to mobile users and he shouuld be on the driving seat. If you apply as a rule what you just wrote you're actually making a choice on behalf of the user and of the content owner.

Sites that do adaptation are spending money to change the content to fit the mobile browser and spending more money in user interfaces and making sure that the approptiate content is served to users on the move. Mobile users will often have different needs from desktop users. It is correct to say that the "web technology" is the same, it is still HTTP and XHTML, but what you serve is different.
Take a look at the desktop site of Alitalia and then look at the mobile version. Don't you agree that the mobile version is providing the type of content that you would need while sitting in cab to the airport and the standard version is the one that you would need while at home planning your holidays? These two sites provide a different URL so users are allowed to make their choice based on the URL, but with device detection and content adaptation site owners can take advantage of a simple name that users can remember and always use the same and access the appropriate content based on the context (mobile or desktop). Want to call this "branding"?

Access Google Reader with your desktop browser, then access it with Opera mini on your phone and then access it with the browser that is pre-installed on your mobile (always without the help of WTE, of course). The first two will provide the same interface, on the desktop PC is very usable, on Opera-mini is un-usable. The last one will provide a different experience with the same content and will be optimized for your browser and your hardware and this means to your context: you're on the move, don't have a pointing device (in most case) most likely want to read the latest news, if this is the case (and it is for most mobile users).

- Andrea
nigel

Rank: Alpha
Posts: 8
Joined: 9/14/07
RE: Rationale behind changing the User-Agent... as a reply to mrbgturner.
9/19/07 5:10 PM
Again. My point is, please leave the User-Agent header alone. I'm going to rebuke what you said point for point.

mrbgturner:
Vodafone is offering a PC experience to customers.


I don't dispute that. You want to transcode sites that are written for the desktop? That's fine with me. I have things to say about the user experience of transcoded sites, but that's another topic. But please don't do it at the peril of all the site owners that tailor their content to phones, and don't do it in a way that you are breaking standards and mess with existing practices.

mrbgturner:
The desktop user agent string is sent primarily to get desktop internet content vs. mobile pages, not to get desktop content vs. nothing at all.


I don't think you understand my argument laid out in my initial post. Plus, what do you mean by "nothing at all"? As a solution laid out by someone here (I think it's jalberto). The HTTP protocol actually does have a suitable mechanism for an resource/origin server/site to tell the HTTP client that the request can't be met. It's the 406 HTTP code. You send the original User-Agent header, if the site can't handle it, it sends 406. Then you make another request on behalf of the phone with the PC user agent header.

mrbgturner:
Well known desktop sites offer mobile versions because they know that most phones can’t handle their full site.


That's exactly the point, and you are arguing against yourself. But without sending the sites the original User-Agent, how would a site know to return mobile content?

mrbgturner:
But with the WTE, all of these (WAP2.0) phones now can access their full site.


So now you are arguing that you can do a better job transcoding their desktop site, than their carefully crafted mobile site specifically designed for mobile devices?

mrbgturner:
We cannot guarantee content return by sending the mobile user agent. I do accept your point that many sites will return the content. Some will not and this is the topic of the W3C group on "blocking sites".

You mentioned that you didn't like the discussion being diverted to standards but that is the way the mobile industry works.

Future standards and recommendations are needed not just on this point but on Content Adaptation as an industry. There are many issues from user agent to content control to new business models.

The topic of "Mobile User agent use" is not "closed" by Vodafone by the way.


I've said, don't mention W3C. And here you go again. I say again: what you are ALREADY DOING is not standards-compliant. This is like stabbing someone while you are part of the legislature, and at the same time you are trying to make stabbing someone legal. :)

mrbgturner:
Vodafone will be listening to the recommendations in this area. If the recommendations consider different usage of the mobile user agent we will consider those but they have to make sense in this new world of html and wml content.


From the response I get, I don't think you are really listening. Or perhaps, not really understanding?

mrbgturner:
I have stated many times that this area is not exclusive to Vodafone and over the next six months you will see more activity from others.


You don't have to wait six months. You are seeing activities now already, from mobile site publishers.

mrbgturner:
We have heard the strong views expressed on this site. That is the point of the site, to allow a constructive voice to be heard and consider them.


There you have it. So please give us back the User-Agent.
jo
dotMobi
Rank: Alpha
Posts: 5
Joined: 9/12/07
RE: Rationale behind changing the User-Agent... as a reply to mrbgturner.
9/20/07 10:11 AM
mrbgturner:


The desktop user agent string is sent primarily to get desktop internet content vs. mobile pages, not to get desktop content vs. nothing at all.



Brian

I guess I hadn't appreciated that was your intention. I thought it was fall-out from your desire to avoid blocking behaviour.

In our work in the Mobile Web Best Practices Working Group, we ask people to consider the user's context and to provide a "Thematically Consistent" user experience, not necessarily the same user experience as they would experience were they using a desktop. The reason being that often the purpose of a Web site is better realised in a mobile context by tailoring the navigation and the content with mobile rather than desktop use cases in mind.

I think it is at best highly questionable for you to interfere with a Web site has specifically created an experience for the mobile user, and to thwart their intentions by deliberately misleading them as to the user's context.

Jo
Post New Thread Subscribe

Red stars = Average rating

Yellow stars = Personal rating

When you have downloaded you can rate the application by clicking on a star

Download

Send To Mobile

Project Title Search