Solving big business problems in our little toolbox application. A use case for Project Distributor.Project Distributor: Introduction to our distributed web service model
So Darren and I have put in about a month now on the Project Distributor website. We are starting to reach that critical point where the site is pretty cool, we have plenty of users, we are thinking about running out of the allowable bandwidth for the demo site, and all sorts of other things that tend to happen all at once. Now, there are some problems you can design yourself out of, and others that you really have to throw some money at. Our latest enhancements can be summed up in a short list.
- Buy a domain name and start hosting in two places. Project Distributor.com should be up fairly soon to accompany MarkItUp.ASPXConnection.com
- Have people host their own versions of the application. And that means a big source release is in the future. At this juncture risk fragmentation.
- Design away fragmentation with a series of ingenious features that will make everyone want to use the application at hand.
I'm here to talk about the last two, since Darren already bought some additional hosting for us. The concept will be to release a fairly stable version of the application so that groups can host tools, code snippets and other source/binary releases for their teams to share. The application is very lightweight and easy to set-up, so it won't require a bunch of hand holding and configuration to get up and running initially. From our standpoint we solve a number of issues at this juncture. The most obvious problem is what we classify the Lutz Roeder use case. .NET Reflector is the key type of application we'd love to get hosted because it makes it a bit easier to find, not that Google does a bad job, we'd just like to get a bunch of tools in one place, with some features for feedback, new releases, and some cool client tools for publishing.
Now, Lutz would put his application up and he'd whack our bandwidth. He is the prime example of someone that should be hosting their own tools, but possibly using our interface. He doesn't have to, we haven't even asked him yet in fact, but if he decides to do so, then all the better for the web application moving forward. Users such as Lutz probably want a certain level of control over their own sites as well in terms of branding and controlling access. This will only come from hosting the application yourself (and maybe some other features we'll see later).
From a security standpoint many teams will also want to host their own servers. In this manner they get control over the hardware their sources and binaries are stored on. They can accept tools up to any maximum (instead of our imposed limits) and provide unlimited download bandwidth if they choose. Or they can take advantage of our gating mechanisms to make sure their server doesn't get overloaded with downloads and open their tools up to the public.
The only major problem from this source release is that the initial problem we were trying to solve, promoting the visibility of tools, starts to erode. You see, the more sites that host their own tools the harder it is to find the right site with the right tools. We are trying to solve this in a number of ways. The first is allowing users of a site to store bookmarks to other projects and external resources. This is only a temporary fix, because it still doesn't allow a mass search and categorization infrastructure required to truly promote the visibility of the tools being hosted. We have to come up with a solution that brings all of the sites, but we don't want to create just another portal or gateway site. That is boring. Now you have the background, so how will we solve the fragmentation issue?
Designing away Fragmentation
I won't lie to you, I've implemented this model several times, but have never had a project that was capable of really showing off the feature set we are about to talk about. The concept is to unify all of the sites, by allowing them to easily manage views of data from all of the sites combined. Each site owns their own content, maintains their own users, but in turn peers with other sites to obtain additional content.
Web services provide a dual feature set in this model. At the current level they allow us to generate really great client-side tools for managing, well, your tools! We have a drop-client target right now so you can drag and drop new releases to existing projects in just a few seconds. Some new tools for working with build systems to promote the source code up to the server are in the works. We natively integrate with your RSS reader and will have our own alert services in the drop client just in case you don't have one. There aren't any search or local caching features, but those are also planned for the drop client so you can background download new releases, just like Windows Update.
That doesn't solve fragmentation though, that just makes me realize how much work I have left to do. The second feature of web services lies in the ability for each site to aggregate data from the many other sites that are out there hosting the application. Remember, everything we make available at the service layer can also now be remoted. The more caching we put into the data layer, the more performant the entire process will be, and we can even tune the caching depending on whether the data layer is merging off-site contents or database contents.
Peer Sites
I'm sure there is another name out there somewhere, but for the past 2 years I've called these peer sites. Each instance of the project distributor will have a number of options allowing for adding peers that will be aggregated and added to the local collection while users traverse the site. The first step is to get the peer sites running in a read-only mode. And set up some really great options so the entire process can be controlled. This solves a number of use case scenarios for us including the following.
- Fragmentation can be mitigated through proper configuration. If everyone aggregates 5 or 6 sites into their peers, then we have a huge network now of interconnected peers and users can pick and choose which one they use for purposes of searching the tool network.
- Peer connections are unidirectional or bidirectional. Access is configurable. Teams can include tools from external sites while keeping their own tools completely private. They can exist behind a DMZ or a private network.
- Users can host their own personal tool sites in the same manner as the team sites. They can configure statically which projects to make available even. In this way you can build a collection of personal tools that you love, and have the latest information automatically update on your machine for your perusal.
Peer sites solve plenty of visibility issues, but that is pretty much all they solve for now. We still want to enable all of the features available to the client tools. After all, the web service methods and proxy infrastructure is in place to do so much more.
Master Sites
Well, we want to solve another problem. That is where you edit your data. A master site is where the users, groups, projects, etc... are all hosted, but thankfully, you'll be able to log in through any site (assuming it is peered with your master site) and then edit your own projects and such. This is a remote principal context and is actually one of the cooler features associated with the peering functionality of project distributor. We'll be fully secure in our login and credentials region, but unfortunately we'll still be transferring data in open text in the short term. Maybe we'll fix that with enough push back.
Clone Sites
A clone site is where we empower a site to act on behalf of a master site. For me, my local project distributor is currently cloned to the main project distributor site. What does this mean? Right now it means I get all of the data from PD, and that users who trust my site can log-in to their project distributor accounts and cross edit data. Pretty nice if you ask me. It basically means you can fully host a project distributor installation and never, ever have to install a database server. Users can just act on behalf of a remote server.
Configuration
This isn't a super reusable model like some of those you read about in the popular software architecture books, and it probably accounts for why master/peer/clone sites don't exist very often. The considerations for every option are heavily customized to the problem being solved, and I'm sure we'll be making modifications or updating the configuration context for a while. Right now you can independently configure your primary server type, whether master or clone, whether or not users can use you for a pass-through authentication and edit server, whether or not web services are enabled so peers can enable unidirectional only communications, setting up asymmetric security credentials. Man, you name it and it is in there
For the peer section we have full and selective modes. A full peer pulls all of the data on the remote peer locally for display (in a delay caching manner, just like you'd expect, unless you set up a scheduled pull which is also possible). I expect most people to configure full peers because they really are really easy to set up and maintain. A selective peer is where you specify the groups/projects that you want to display. This is best for a user setting up their own personal toolbox who wants to select a couple of items from many different peers.
We have an extensively exhaustive configuration module already and we'll be continuously adding more to it. The concept is to easily modify your toolbox to your own designs without having to touch the code. If we haven't given you enough options to satisfy your need then we'll have to make something up, because I'm just about running out ;-)
These are the basics of the model ideas I have for project distributor. That doesn't mean Darren doesn't have other great ideas happening as well. He has some pretty extensive UI enhancements, but I'll let him talk about those. We even have another product idea that is kind of a bolt-on for project distributor, but that is probably a couple of months out putting it into next year. Unfortunately we have too many ideas for our own good right now. Better than not having any ideas I guess. I'll try to drop some code with some of the ideas above, that way you can get a look at how the entire system is implemented. I have some diagrams as well, but I'm far too tired right now to add the img tags to the HTML view.
AccessibilityFive new links: "Board Names Advisory Committee for 508 Standards Update", "Shawn Henry Podcast/Interview on WCAG 2", "Accessible Digital Media", "Walgreens Recruits Employees With Disabilities Through Highly Accessible Website", and "Replace Your Mouse with Your Eye".
read more: How to rip and compress DVDs in Mac OS XA couple of months ago, I got a Mac Mini* and immediately (of course) hooked it up to my TV so I could use it as a media center. (That’s probably a good topic for a separate post.)
Since then, I’ve ripped my DVD collection onto the Mac so any movie I own is only a few clicks away. Here’s how you can do the same thing:
1. Insert a DVD in your Mac’s DVD drive
These directions are optimized for feature films, not TV shows or other things you might find on a DVD. However, with a little creativity you should be able to adapt these instructions to serve your purposes.
2. Use MacTheRipper to do a “Main Feature Extraction” to your Mac
I use MacTheRipper first because it allows me to archive a raw VIDEO_TS folder that I can re-compress later if I want. For more detail about doing a simple DVD-to-disk rip, see the first half of Mark Pilgrim’s excellent how-to video.
Here’s what my MacTheRipper settings look like:

3. Use HandBrake to compress the movie
This part is critical because there aren’t many programs (including Front Row) that know what to do with a raw VIDEO_TS folder. But nearly any video player (again, including Front Row) can handle an MP4 file, so that is what we will convert this movie into.
In HandBrake, I use the XviD encoder with a target size of 1000MB (about 1GB). This produces a very watchable picture at a reasonable file-size.
Here’s what my Handbrake settings look like (click to enlarge):

Put the video file in your Movies folder, and enjoy!
You can obviously keep your movies wherever you want, but I keep mine in the Movies folder (under my home directory) so Front Row can access them.

Give it a try!
Feel free to try this yourself, and let me know if you have questions!
* * *
* The Mini was a gift from my generous Grandpa, who you may recognize from his occasional comments on this site.
read more: The Lack of Interactivity and Hypertextuality in Online MediaThe main focus of this article is related to the forms of mediated content that are offered in online space.
Oblak, Tanjaread more: WebMaster Media Maker.Create Streaming Audio and Video with Media players that do not require a streaming media server.
read more: Companies Up Spending for Wireless Infrastructure, AppsCompanies are building on-campus networks and seeking a secure way of supporting remote workers.
read more: Online Collaboration Tools And Resources: Kolabora Picks n.4Photo credit: Miguel Ugalde Web-based shareable calendar launched by Google Manage audio conferences with up to 500 users on Skype High-performance new videoconferencing tool Share anything from video to text Direct share of media files This week also, I...
read more: Ron Pomerantz becomes executive creative director at Disney ChannelMedia Life Magazine Jul 16 2006 1:12PM GMT
read more: Overnights Sinking feeling: 'Master of Champions' ABC reality contest pulls a 1.2 in 18-49s, behind all but the WB and UPN and well down from debut. 'Dance' boogies to a win.Media Life Magazine Jul 16 2006 1:11PM GMT
read more: NetX 0.4 released[2002-03-26] Netx is an open-source JNLP client which downloads code over the network, caches it, and runs it in a secure environment. Netx runs Java applications and applets using JNLP to describe what resources to download and how to execute the code.
read more: On the goofy statement from ''the Vatican''"Hezbollah, Iran's proxy, used the safety of its Lebanon position to attack civilian populations in Israel. And Israel is supposed to just sit there and take it? Are the only good Jews those who go meekly to their deaths at the hands of cutthroats?
"And what about the Lebanese Christians, most of them Maronite Catholics? Does the Vatican suppose they welcome the militant presence of the Islamofascists in their country, these terrorists who are bringing such destruction onto Lebanon? There will be no secure peace for the Arab Christians of Lebanon as long as Hezbollah remains a force."
Michelle Malkin has more reactions by other Catholics,
who know that Sodano is a raving euro-liberal who's retiring in September (finally).
Great
comments at Amy's, pro and con.
Plus: Read
David Warren's thoughts on "The War of 2006".
read more: Mark Steyn, Hugh Hewitt & me
Oh my!:
"HH: So Mark Steyn, do you think the American political electorate is watching this, and understanding again what we talk about a lot. There's a serious party in the United States. It might not be always right. It isn't always right. It makes mistakes. But there's also a fundamentally feckless and silly party, and it's the Democratic Party, and it's the political left.
MS: Yeah, well, you know, a Canadian blogger, Kathy Shaidle, who I like tremendously, her website. She said you know, Alan Colmes has said he's agnostic on the matter of whether 9/11 was an inside job. Now let's take him at his word.
If these people, high up in the Democratic Party, seriously thought the president of the United States had committed, deliberately killed thousands of Americans...you know,
Kathy said if that happen in her country, in Canada, she wouldn't want to live in that country anymore. She'd get her passport, she'd get her stuff together, and she'd get out of there.
And the fact that you can sort of say Bush killed thousands of Americans, and then sit out on your cafe in San Francisco, sipping your venti latte, as if that's just something normal... I mean, this is pathetic. There's a disease in the Democratic Party that they've got to cure, because it's not good for the political system."
***
Well, and my big thrill for today was gonna be cleaning the oven and watching
Wasp Woman on the Drive-In Channel. Thanks to
James and
Deborah for alerting me about the media.
read more: Do You Remember the 70s, 80s and 90s?Wordsun's own Michael Johnson has recently launched his new website http://www.DoYouRemember.co.uk. The website is a memorabilia and nostalgia website where visitors can share their memories of what they remember from the 70s, 80s and 90s.
TV shows, movies, music and toys are amongst the items being discussed.
The site has already picked up impressive media coverage with an entry in USA Today and even a mention in the Honolulu Advertiser!
read more: Minnesota Businessman Teams with International Boxing Legend, Roberto DuranJohn Laub teams with Roberto Duran to launch Blue Bridge Media a business that is redefining the taxicab in Panama. (PRWEB Jun 26, 2006) Trackback URL: http://www.prweb.com/chachingpr.php/U3VtbS1Qcm9mLUhhbGYtQ291cC1JbnNlLVplcm8=
read more: DC-based Media Company, Brand Nu Words, Teams with the Allen Iverson Celebrity Summer Classic to Show that Philanthropy is Still ThrivingBrand Nu Words author of NAPPY and DJ/Harvey Nunes team with the Allen Iverson Celebrity Summer Classic to show that philanthropy is still thriving. (PRWEB Jul 14, 2006) Trackback URL: http://www.prweb.com/chachingpr.php/WmV0YS1JbnNlLVRoaXItU3F1YS1JbnNlLVplcm8=
read more: Social Networking Site to Impact Social ResponsibilityPetBoogaloo will be making 10 important announcements over 10 consecutive days, to publicize a big plan to help animal causes and the environments in which animals live. PetBoogaloo will be using their social networking platform, multiple forms of media, as well as their site icons to educate people about these important issues. The plan is similar to Smokey the Bear’s campaign, which is the longest running public service campaign in US History. (PRWEB Jul 10, 2006)
read more: Chicago Critic Champions Women Filmmakers; Wins Second Consecutive Achievement AwardChicago film critic Jan Lisa Huttner recently earned her second consecutive Silver Feather Award from the Illinois Woman’s Press Association, for writing the most award-winning articles in IWPA’s annual Mate E. Palmer Communications Contest. Last year Huttner’s writing won 10 honors, one of which went on to win first place in the “Best News Writing for the Internet” category from the National Federation of Press Women (IWPA’s parent organization). “Jan Huttner brings expertise, ethics and enthusiasm to all her writing projects,” explains IWPA Contest Chair Pat Szpekowski. A go-to source for information on women filmmakers, Huttner has spoken out widely against the “celluloid ceiling” that keeps women screenwriters, directors and other behind-the-scenes professionals from having the same opportunities as their male colleagues. “To use the words of Professor Martha Lauzen,” says Huttner, “If we change media messages, we change the world!” (PRWEB Jun 20, 2006) Trackback URL: http://www.prweb.com/chachingpr.php/U3F1YS1Mb3ZlLUhvcnItU2luZy1JbnNlLVplcm8=
read more: Time Domain Signs Exclusive License to Provide Ultra Wideband Products to the Healthcare IndustryParco Merged Media and Time Domain sign exclusive worldwide license agreement for UWB RFID in the healthcare industry. New product lines and performance criteria for RTLS and tracking announced. (PRWEB Jun 26, 2006) Trackback URL: http://www.prweb.com/chachingpr.php/Q3Jhcy1QaWdnLUluc2UtQ291cC1JbnNlLVplcm8=
read more: New Wellness Portal Emphasizes Collaboration and CommunityA new collaborative, interactive, multi-media health, wellness, and fitness portal, OptimumHealthClub.com, is now live on the Internet. (PRWEB Jun 21, 2006) Trackback URI: http://www.prweb.com/dingpr.php/U2luZy1aZXRhLVByb2YtU2luZy1JbnNlLVplcm8=
read more: Vitrium Develops Secure DRM System for PDF DocumentsVitrium Systems has developed a secure online distribution system for PDFs that allows the publisher to control who accesses the document and reports back on who read it.

read more: Clip Notes file contains video but no audio (Adobe Premiere Pro 2.0)IssueWhen you create a Windows Media format Clip Note in Adobe Premiere Pro 2.0, the file contains video but no audio.DetailYou did not set the export module selected in the Adobe Media Encoder to Windows Media. SolutionsDo one of the followi...
read more: Error: ''Audio Upmixing is not allowed'' when you export (Premiere Pro 1.x, 2.0)Issue When you export a Premiere Pro project through the Adobe Media Encoder, Premiere Pro returns the error message, "Audio Upmixing is not allowed. Cancelling the operation."DetailThe destination audio format contains more audio channels than th...
read more: Warning: ''System restore is turned off...'' when you install Photoshop Elements 4.0 (Windows)IssueWhen you install Photoshop Elements 4.0 you see the warning message, "System Restore is turned off. If you continue Setup, you will be unable to use System Restore to restore the version of Windows Media Player that was included with the Windows ope...
read more: Growth Stocks Specialists Launch CCM SectorPortfolio SeriesCronus Capital Markets, a leading provider of sector research, intelligence, and media to the investment and business communities, has announced the launch of their CCM SectorPortfolio Series. This series provides sector research and identifies the best growth stocks for a range of emerging high-growth sectors. [PRWEB Nov 9, 2005]
read more: BusinessEdge Appoints John Gonsalves as New PartnerCommunications and computing industry expert John Gonsalves joins BusinessEdge Solutions Communications, Media and Content Practice [PRWEB Nov 8, 2005]
read more: CTQ Media Acquires Sourcingmag.com, the Leading Independent Portal for Business Process Outsourcing InformationCTQ Media LLC, publisher of the world?s leading Six Sigma portal, iSixSigma.com, announced today it has acquired Sourcingmag.com (www.sourcingmag.com), an online business publication providing practical guidance on business transformation through outsourcing. [PRWEB Nov 7, 2005]
read more: Houston Marketing -- Sharon Dotson Wins Two National Public Relations AwardsHouston Marketing and Advertising -- Houston Marketing and public relations expert Sharon Dotson is recognized for outstanding achievement in media relations marketing. This is the third year in a row that the two largest U.S. public relations professional organizations have recognized her agency?s work. [PRWEB Nov 9, 2005]
read more: Communications and Media Consultancy Elemental PR RebrandsCommunications and media consultancy Elemental PR rebrands as Elemental Communications launching a new website. [PRWEB Nov 4, 2005]
read more: Moniker.com Wins Special Secure Domain Registration AwardFast Growing ICANN Accredited Domain Name Registrar wins Special World Association of Domain Name Developers (WADND) Award recognizing secure domain registration. [PRWEB Nov 3, 2005]
read more: Bharosa Announces Online Authentication Solution to Counter Check 21-Based FraudBharosa, a provider of secure multifactor online authentication solutions, today announced a solution to authenticate users at the point at which they access highly sensitive digital check images online. The new product, Bharosa CheckPad? expands Bharosa?s bundled suite of Virtual Authentication Devices?, answering demand from financial institutions for Bharosa patent-pending technology applied to digital check image encryption. [PRWEB Nov 7, 2005]
read more: Duquesa Marketing Appoints National Media Booking AgentSlate of interviews to highlight importance of small business development and entrepreneur-ship. [PRWEB Nov 3, 2005]
read more:
You Searched for secure media
Click secure media to go to MMK Technologies
SEARCH RSS NEWS USING THE WORDS BELOW
secure media |
protect audio |
video stream protection |
MMKTechnologies |
MMK Technologies |
prevent audio theft |
prevent video theft |
web page design |
ecommerce shopping cart |
shopping store ASP |
sell online |
sell products |
products to sell online |
web technology |
website builders |
web site builder |
bradenton web design |
florida web design |
bradenton website design |
protect MP3 |
keep video from being copied |
sarasota web design |
secure upload video |
web programming |
cgi programming |
net hosting |
net development |
flash design |
flash programming |
cool flash |
action script |
flash database programming |
flash graphics |
graphics design |
graphics disign |
flash disign |
web disign |
web design |
website design |
internet marketing |
web marketing |
web site marketing |
programming |
web sites designer |
web designs |
internet design |
programming developer |
website marketing |
web development |
marketing internet |
web sites designing |
site designs |
sites designs |
internet designer |
internet designs |
e-commerce store |
web development |
web site development |
design webs |
internet site marketing |
internet hosting |
internet host |
web hosting |
web host |
sell on the internet |
sell on the web |
e-commerce store |
internet development |
webdesign |
florida web site design |
website development |
ecommerce store |
sell online |
affiliate program |
asp web store |
marketing program |
marketing software |
submission software |
asp programmer |
cgi store |
perl store |
internet store |
database programmer |
internet database |
online marketing |
ecommerce software |
streaming media |
video streaming |
secure video streams |
media streams |
audio streaming |
MP3 security |
avi security |
Windows Media Security |
protect video |
secure web cam |
webcam security |
video piracy |
media piracy |
windows media player security |
secure media |
ZDMAK BMW tools Audi tools
Web Design Hosting and internet marketing by MMK Technologies
(c) Copyright 2005 MMK Technologies.